Are there any caterers in Atlanta that would cater for a 2 person romantic picnic at Piedmont or Grant parks?

Not sure you really need a caterer for this. Do you want staff serving and clearing present for the entire event or would it be more romantic if just you two? If the latter try the specialty food stores in Virginia Highlands area for a special picnic basket. You may find more ideas in Creative Loafing.