Keeping in mind that the earth undergoes constant changes and is continually moving through space, I think that most time travelers to the past started out from a safe present location, but when they reached a destination in the past, they rematerialized inside of a mountain, or underwater, or in a rock, or in outer space. The rest died from diseases that we have no resistance to. If they arrived safely, then they faced to same problems on the return trip.