Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by mikek on Monday March 13, 2023 @04:52PM
(#35142397)
Apple comes to mind.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by BryantD on Monday March 13, 2023 @05:49PM
(#35143357)
Agreed. Apple will run models remotely if necessary, but from a PR perspective they align with their stated intentions when they can run locally.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by mustacheemperor on Monday March 13, 2023 @08:27PM
(#35145441)
Oh, how I hope there is a project ongoing at Apple right now to implement some kind of on-device LLM that can drive the phone a la Siri. Any time I open the Bing app on my iPhone to answer a question I think of how useful it could be to ask it to update my calendar, fill out a dinner order, etc. How much time do we collectively waste putzing around with delivery apps etc?
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by smoldesu on Monday March 13, 2023 @08:48PM
(#35145671)
It would be neat, but iPhone hardware has limited memory (and iOS limits that usage further). It would be much faster and higher-quality to run it as an API request like it is today.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by yieldcrv on Tuesday March 14, 2023 @02:33AM
(#35148078)
Given the incentive, it can push the hardware in this direction.
Or they’ll do a home network device like implement it like a HomeKit hub. So the plugged in resource has more computational power and feeds it to iphones when nearby. Disconnected, the iphone uses a much more rudimentary one or falls back to Siri or a cloud service.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by gpderetta on Tuesday March 14, 2023 @04:40AM
(#35148764)
Your phone can remotely connect to your home device when needed.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by smoldesu on Tuesday March 14, 2023 @10:29AM
(#35152100)
Maybe it will use lasers to paint a smiley face on my wall!
Only two things are for certain; you'll have to pay for it, and it will not be cheap.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by gpderetta on Tuesday March 14, 2023 @04:39AM
(#35148760)
Apple Siri as a device you can run on your home as a digital assistant.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by flangola7 on Monday March 13, 2023 @04:53PM
(#35142406)
Who said anything about companies? Companies don't benefit by giving people free access to buildings full of books and knowledge, yet here they are.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by atleastoptimal on Monday March 13, 2023 @05:17PM
(#35142835)
In the last 50 years of AI research has any academic institution ever provided open source easy to use tools like the stuff big companies have put out in the past 5 years?
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by simonw on Monday March 13, 2023 @05:33PM
(#35143115)
Stable Diffusion came from an academic research lab.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by atleastoptimal on Monday March 13, 2023 @08:09PM
(#35145247)
I thought stability AI was a private company
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by simonw on Monday March 13, 2023 @11:08PM
(#35146887)
They are, but the team who trained Stable Diffusion are from academia. Stability sponsored the model training costs.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by flangola7 on Tuesday March 14, 2023 @01:18AM
(#35147703)
As I'm aware neither had put out any such tools for 45 years
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by niemandhier on Monday March 13, 2023 @05:01PM
(#35142549)
Companies like Facebook can harm their competitors by releasing models.
Facebook is not a major player in the Llm field, the technological advantage of openai is to large, BUT they can reduce the expected gains of their competition by providing less powerful alternatives for free.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by ALittleLight on Tuesday March 14, 2023 @04:29AM
(#35148698)
Facebook may destroy their social networks by releasing LLMs. What will happen to spam when it could be driven by local LLMs? You'll have realistic accounts, with realistic pictures, posting realistic messages only to spam links or ads x% of the time.
(Though to be clear I do hope Facebook does release more models because I want to play with them)
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by smoldesu on Tuesday March 14, 2023 @10:31AM
(#35152139)
I wouldn't count on it. However, I definitely think Facebook's remaining managers are scrambling to control this LLaMa leak though. They don't want the liability or responsibility of managing this project, and now everyone and their mother wants to play with it. Battling spam can largely be managed through the usual methods, but fighting a leaked model is much harder.
There is no company on the planet that would benefit from providing people local means to run LLMs. As a result only hacks and leaks will be how individuals can manage to run LLMs outside of heavily monitored remote API calls.