News for hackers. Stuff that matters.
Re:Meta Open-Sources Megalodon LLM for Efficient Long Sequen... by 1024core on Tuesday June 11, 2024 @02:50PM (#40649985)
MEGALODON builds on the research team's previous model, MEGA (exponential moving average with gated attention)

I like how the team gingerly avoided calling the previous model "MAGA" ... :-D

Re:Meta Open-Sources Megalodon LLM for Efficient Long Sequen... by codetrotter on Tuesday June 11, 2024 @02:57PM (#40650068)
I could give two sh*ts about Mr D.T. but I’m more curious to see the reaction of one Kim Dotcom, aka the Mega dude himself.