You were never not born, and you will never be dead. The concept of time is meaningless if it's not experienced, so as far as you're concerned it won't exist, and what doesn't exist can also not be infinite.