News for hackers. Stuff that matters.
Re:Training great LLMs from ground zero by nl on Thursday March 07, 2024 @08:08AM (#39628601)
> 20GB json file… takes 6 hours just to load

Err you definitely should be doing something about that.

20GB on T4s (how many?) isn’t really comparable to terabytes on thousands of A100s.

There are no comments on this comment yet.