News for hackers. Stuff that matters.

A comment on Google “We Have No Moat, and Neither Does OpenAI”. Parent comment

Re:Google “We Have No Moat, and Neither Does OpenAI” by yieldcrv on Thursday May 04, 2023 @07:22PM (#35823417)
nah, Lora quantized LLM’s are going to be at the OS level in 2 years and consumer architecture refreshes are just going to extend more RAM to already existing dedicated chips like Neural Engine

client side tokens per second will be through the roof and the models will be smaller

[ Parent | on HN ]
Re:Google “We Have No Moat, and Neither Does OpenAI” by computerex on Thursday May 04, 2023 @08:08PM (#35823793)
LoRa is not a quantization method, it's a fine tuning method.
[ Parent | on HN ]
Re:Google “We Have No Moat, and Neither Does OpenAI” by yieldcrv on Thursday May 04, 2023 @08:49PM (#35824050)
you read that whole paragraph and assumed this prediction didn't involve consumers using fine tuned models despite lora being explicitly mentioned?

-EQ moment

edit: its about the combination of those methods making models accessible on consumer hardware

[ Parent | on HN ]
Re:Google “We Have No Moat, and Neither Does OpenAI” by robbintt on Friday May 05, 2023 @12:00AM (#35825061)
It's two adjectives on the noun.
[ Parent | on HN ]