As someone with retrograde amnesia, I can confirm - this is exactly what it feels like. It's very interesting experiencing (essentially) the first few years of your life while being fully alert and forming memories.