This... is what made me get over the fear.

If there really is nothing... give existence an infinite amount of time, and whatever random processes created us to exist in the first place - the chance of this happening again is 1/1. And the time this will feel like to us? Absolutely nothing.

So don't worry too much, you'll get a much needed break if this is the case. You will get to experience true peace.