Frank Stitt has 4 restaurants I believe and I would highly recommend Highlands Grill. I am pretty sure they are all close together--his bistro one is. His places would be good any time.

In addition to Highlands Bar and Grill, which is not open on Sunday, but would be an excellent option for Saturday night, another choice would be Hot and Hot Fish Club. The chef, Chris Hastings, recently beat the Iron Chef on the popular food show. Also not open on Sunday. Reservations highly recommended at both places. Chez Fon Fon or Bottega (or Bottega Cafe, next door--also Frank Stitt locations) are other options.

Sunday brunch -- the Birmingham Museum of Art has a cafe with a nice brunch (Oscar's, I believe, is the name of the restaurant). Or, for something more eclectic and local, you might try Chez Lulu, in English Village. This is a small, quant location with a unique menu with only a few tables inside and a handful outside, a lovely and charming experience, but nothing fancy like the others.

What to do -- The Civil Rights Museum is interesting if you want a little history, or if you have children with you, the McWane Center is fabulous fun. The Zoo isn't too bad, or Botanical Gardens, and both are close enough to downtown. If you want to shop go to the Summit or Mountain Brook Village. I'd probably choose to go the the Birmingham Museum of Art for the afternoon, where they have the largest selection of the Kress Collection outside of the National Gallery, as well as a lovely collection of Wedgewood, and the largest selection of Asian art in the Southeast. It's a very manageable museum for an afternoon.