Time Travel

As we had established earlier on in GenChat, time is relative, we do not necessarily move true forward or true backwards, we move in relative forward and relative backwards. What if time travel in the true backwards direction is impossible because it is still relative forward for us? For example, what if I travel from 2016-2014, that would mean I traveled 2 yrs into the past, but I would've aged 2 yrs. So what if it's not that there are no backwards time travelers, it's that they cannot go backwards too much or else they'd be too old and die?