I've just had a look at the episode as l don't remember noticing the other buildings before. If I have my bearings correct, they were a bit further back from the road and they look pretty derelict. Looking at historic aerial photos, the new house at the back of the plot was built in the mid-80s, and I can't see any trace of the other buildings in the 1993 image.
The address was/is 2201 Lenora Road near Loganville, GA. The Google car went down the road in February 2022, so we can finally get ground levels views. As far as I can tell, the chimney is still there - check out the Streetview.
Amusingly, there's a sign right outside where the Duke farm house used to stand that says "Road Closed At Bridge". Big Hayes Creek is about a mile down the road. If that's not an invitation to jump, I don't know what is!