News for hackers. Stuff that matters.
Re:Training great LLMs from ground zero by gwern on Wednesday March 06, 2024 @09:13PM (#39624346)
> And we are using the older Tesla T4.

That's an undemanding and well-debugged chip by this point (6 years ago!). So you aren't experiencing any of the pain people using A100s or H100s (never mind people who have to stand up clusters with B100s soon) are going through now.

Re:Training great LLMs from ground zero by icpmacdo on Monday March 11, 2024 @01:21AM (#39665136)
> never mind people who have to stand up clusters with B100s soon

Gwern(or anyone else) do you have any resources on this?