News for hackers. Stuff that matters.

A comment on DeepSpeed Chat: Easy, fast and affordable RLHF training of ChatGPT-like models. Parent comment

Re:DeepSpeed Chat: Easy, fast and affordable RLHF training o... by MasterScrat on Wednesday April 12, 2023 @09:05PM (#35549480)
No, you can see the time breakdown in the table under the "coffee break" quote: it is the time for the 3-step RLHF process only. Training a 1.3B parameter model from scratch is still a very large undertaking.
[ Parent | on HN ]

There are no comments on this comment yet.