They return to around the time they left. Time at home doesn't seem to continue on much further, not like here. People from the same world who come at different times typically vouched for seeing the first person recently.

[Damian shrugs then crosses his arms over his chest. He can't even be irritated Nico is asking a thousand questions. He's glad someone new is, at least. Questioning is good.]

Join the club. It won't get any better here. If anything, it'll get worse, and you'll keep coming back over and over for more.