Re:Jailbroke Google Nest Mini run your own LLMs, agents and ...
by cuttysnark on Wednesday July 19, 2023 @02:41PM
(#36791239)
> ... such little hardware (just a small PCB) in the Nest.
> ... have usable and rootable hardware on them to run custom LLMs
All the heavy-lifting is done on the server, hence the board replacement—no need to root. Install your own board with your own firmware which communicates with your own API/servers—where the all heavy-lifting is done.
"smart assistants" are glorified iOT microphone/speaker combos which get all their magic from their connected microservices. A warrantless wiretap, if you will.
> ... have usable and rootable hardware on them to run custom LLMs
All the heavy-lifting is done on the server, hence the board replacement—no need to root. Install your own board with your own firmware which communicates with your own API/servers—where the all heavy-lifting is done.
"smart assistants" are glorified iOT microphone/speaker combos which get all their magic from their connected microservices. A warrantless wiretap, if you will.