News for hackers. Stuff that matters.
Re:Ferret: A Multimodal Large Language Model by Apple by KMnO4 on Saturday December 23, 2023 @01:20PM (#38746563)
Is tiny LLM an oxymoron? I believe Apple has told us it’s a transformer language model, but not specifically a LLM.
Re:Ferret: A Multimodal Large Language Model by Apple by ben_w on Saturday December 23, 2023 @02:01PM (#38747013)
It's like how the "New Forest" is really old now: even small LLMs are (from what I've seen which isn't exhaustive) large compared to Markov language models.
Re:Ferret: A Multimodal Large Language Model by Apple by catoc on Saturday December 23, 2023 @01:27PM (#38746612)
Yeah, they meant a TLM
Re:Ferret: A Multimodal Large Language Model by Apple by 0x1ceb00da on Saturday December 23, 2023 @03:03PM (#38747624)
That's print('Hello, world!')
Re:Ferret: A Multimodal Large Language Model by Apple by astrange on Saturday December 23, 2023 @04:32PM (#38748427)
There's no difference. An LLM is just a transformer language model that's "large".
Re:Ferret: A Multimodal Large Language Model by Apple by hmottestad on Sunday December 24, 2023 @05:47AM (#38752604)
According to this article[1] it has about 34 million parameters.

https://jackcook.com/2023/09/08/predictive-text.html