I can understand your way of thinking as it similar to my belief. I don't believe in time travel cos matter cannot exist in the space that it never was. Man has named past present and future to identify our linear existence.I'm looking at a certain configuration of matter that exists in this present moment. When you look at your memories, you're looking at a certain configuration of matter that exists in this present moment. I can't go back to the same configuration of matter that existed when the post was made.
Time is fixed at a constant speed even though time can be experienced at different rates. You can boil the same amount of water every time and will always boil at the exact same time. Yes certain factors could effect the timing but the baseline is the initial starting point be the same parameters.