News for hackers. Stuff that matters.

A comment on Reproduce GPT-2 (124M) in llm.c in 90 minutes for $20. Parent comment

Re:Reproduce GPT-2 (124M) in llm.c in 90 minutes for $20 by sabareesh on Wednesday May 29, 2024 @12:13PM (#40513555)
This much bigger model (500M), P2P is enabled via Mailbox. It is expected because of memory to compute ratio
[ Parent | on HN ]
Re:Reproduce GPT-2 (124M) in llm.c in 90 minutes for $20 by huac on Wednesday May 29, 2024 @12:20PM (#40513671)
can you elaborate?
[ Parent | on HN ]