Jailbroke Google Nest Mini run your own LLMs, agents and voice models

Re:Jailbroke Google Nest Mini run your own LLMs, agents and ... by thefrozenone on Wednesday July 19, 2023 @01:59PM (#36790555)

I'm surprised there's such little hardware (just a small PCB) in the Nest. Appreciate that source tweet puts "jailbreak" in quotes, it's a board replacement in the shell of Google Nest peripherals.

Are there other smart assistants that we can now get for cheap, that have usable and rootable hardware on them to run custom LLMs?

[ Parent | on HN ]

Re:Jailbroke Google Nest Mini run your own LLMs, agents and ... by cuttysnark on Wednesday July 19, 2023 @02:41PM (#36791239)

> ... such little hardware (just a small PCB) in the Nest.

> ... have usable and rootable hardware on them to run custom LLMs

All the heavy-lifting is done on the server, hence the board replacement—no need to root. Install your own board with your own firmware which communicates with your own API/servers—where the all heavy-lifting is done.

"smart assistants" are glorified iOT microphone/speaker combos which get all their magic from their connected microservices. A warrantless wiretap, if you will.

[ Parent | on HN ]

Re:Jailbroke Google Nest Mini run your own LLMs, agents and ... by GauntletWizard on Wednesday July 19, 2023 @02:41PM (#36791231)

* * *

[ Parent | on HN ]