As soon as they could walk, the girls would follow Empress Celestia everywhere as she went on fulfilling her royal duties. Try as she might, nothing could stop them from following her in a manner akin to baby ducklings. They'd hold on to a bit of her tail, and she'd feel them struggling to keep up through little tugs. She'd slow down then, and feel them occasionally bumping into her legs. Once they could talk, they'd call out some of the things they see, and learn of the things they'd never seen before.
She'd go around town, bringing two toddlers along with her as she smiled and waved, proudly introducing the twins and gushing endlessly about them in a typical motherly fashion to anypony that would listen.
"Oh she floated herself right out of my hug the other day! Talk about being embarassed, huh?"
"I looked everywhere! She was on the chandelier the whole time!"
"I thought the entire castle would catch on fire!"
As it turns out, having small foals tag along and enjoying every moment of it made Celestia a better leader in her subjects' eyes. It was strange, as she'd expected to be seen as an unfit parent. Commoners placed the Empress on such a high pedestal, she realized. They wanted nothing more than to see her children, and was willing to shove aside even her most apparent faults.
They were celebrated.
She's not the best parent, but she's trying her best :)