I've done a bit of both, and in between.
When our second child was less than a year old it worked well to mash in about 5, help get dinner ready, start sparge after kids went to bed around 7 and usually have it all done by midnight (would be finished earlier but a couple of neighbors usually came around after their kids were in bed and we made a night of it
Also did midday, when I could work it around a kid's nap time and have it done between noon and 5pm, and get some house work done in the meantime (always a good way to get in the good books and improve your chances of getting the chance to brew again soon)
More recently it's been a morning affair, mash in around 9, let the missus go for a run while I look after kids, finish off the session around 230.
The thing I've found most helpful I'd putting a timer and temp controller on my electric HLT, I can set it the night before and strike water is ready to go when I am.
Basically any time is a good time to brew!