News for hackers. Stuff that matters.
Re:Training great LLMs from ground zero by StarCyan on Thursday March 07, 2024 @02:29AM (#39626171)
When was this? I use JAX+TPUs to train LLMs and haven't experienced many issues. IMO it was way easier to set up distributed training, sharding, etc compared to Pytorch+GPUs.

There are no comments on this comment yet.