I've worked a little with local VC and they typically seem like they have money to put in but very few vehicles for getting information on where to put it. The startup communication channels aren't there yet, although you'd hope that GT would help to lead the way.
Atlanta is a great place for startups. I've been a part of several here. GT is a great source for new hires. I can't say that I've ever been disappointed with any of the dozen or so new-hire grads that I've worked with from there.
The airport is the busiest in the world and has direct flights to just about everywhere. The culture is a comfortable Southern-friendly mixed with a healthy amount of cultural diversity.
The weather isn't as hot and humid as Texas or Florida, but warm enough to avoid ever having to shovel snow off your driveway.
That said, there's nothing incredible about Atlanta. You'll never have the museum experience of New York, the historic experience of DC, the weather of California, the views of Colorado, or the food of Louisiana. It's got a whole lot of nice, not much bad, but nothing extreme either way.