Re:GPT-3 is no longer the only game in town
by rg111 on Monday November 08, 2021 @06:08AM
(#29148112)
I have never used TRC, but I heard from many that if you reach out to them, they are really helpful.
I have not converted to TPU, because it is literally offered by only one company. It will be the height of "vendor lock-in".
But, I must say that JAX on TPU is faster than anything and everything that I have ever seen.
I'm glad this all worked out for you. This is unrelated, but I just want to say that I hate how many people Google managed to convert to TPU with their research program and that their managed TPU/GPU offerings are absolutely horrible and infuriating to work with unless you somehow get on their radar.