Llama3 implemented from scratch

Re:Llama3 implemented from scratch by fragmede on Monday May 20, 2024 @05:13AM (#40413650)

don't buy into the hype, but when Facebook has spent around as much on GPUs as the Manhattan project (but not the Apollo program), the comparison kinda makes itself.

https://twitter.com/emollick/status/1786213463456448900

$22 in 2008 -> $33 today https://data.bls.gov/cgi-bin/cpicalc.pl?cost1=22&year1=20080...

[ Parent | on HN ]

Re:Llama3 implemented from scratch by ladzoppelin on Monday May 20, 2024 @05:48AM (#40413820)

I read this last week and its terrifying. If the world lets Facebook become an AI leader its on us as we all know how that story will play out.

[ Parent | on HN ]

Re:Llama3 implemented from scratch by thelittleone on Monday May 20, 2024 @07:39AM (#40414394)

We must summon a fellowship of the AI ring with one hobbit capable of withstanding the corrupting allure of it all.

[ Parent | on HN ]

Re:Llama3 implemented from scratch by kreeben on Monday May 20, 2024 @08:00AM (#40414513)

Don't torment the hobbits! Send the eagles right away!

[ Parent | on HN ]

Re:Llama3 implemented from scratch by nicklecompte on Monday May 20, 2024 @09:42AM (#40415378)

The Big Dig (Boston highway overhaul) cost $22bn in 2024 dollars. The Three Gorges dam cost $31bn. These are expensive infrastructure projects (including the infrastructure for data centers). It doesn't say anything about how important they are for society.

Comparing LLMs to the Manhattan Project based on budget alone is stupid and arrogant. The comparison only "makes itself" because Ethan Mollick is a childish and unscientific person.

[ Parent | on HN ]