News for hackers. Stuff that matters.
Re:Apple: Transformer architecture optimized for Apple Silicon by aunty_helen on Friday March 24, 2023 @07:41AM (#35287739)
Honestly, I've looked at shorting MS due to openai.

Their technology (LLMs), or the secret sauce, can easily be stolen just by the process of putting that tech out there.

Have a look at Alpaca, FB made it, someone leaked the weights and now there's a dataset of training it for only a few hundred dollars that can beat openai at its best.

Not everyone needs to employ a PhD for doing customer service, in the same way not everyone needs GPT5 for answering support queries.

Their business model is leaking away from them.

Re:Apple: Transformer architecture optimized for Apple Silicon by anukin on Friday March 24, 2023 @12:58PM (#35292002)
TBH alpaca is nowhere near to chatgpt or even gpt models in its capability. I have been playing around with lama for a while now and even chain of prompts, the quality of answers are really bad. I had thought that Facebook would be having the ability and competence to produce a LLM which can outclass open ai