News for hackers. Stuff that matters.
Re:Falcon 40B LLM (which beats Llama) now Apache 2.0 by Zemtomo on Friday June 02, 2023 @11:31AM (#36166499)
I'm the wrong person to ask but performance wise a 4090 has over a pflop and a Google search also showed a factor of 3-4 for a 3090.
Re:Falcon 40B LLM (which beats Llama) now Apache 2.0 by cjbprime on Friday June 02, 2023 @09:43PM (#36172897)
The relevant performance metric here is memory amount and bandwidth.