Yeah, you seem to remember correctly. Apparently, it just didn't reached its "public beta" until 2006 so that's when they date it's beginning.

https://translatepress.com/history-of-google-translate/