News for hackers. Stuff that matters.

n8fr8too

Re:LibraryBox on Tuesday March 05, 2024 @01:54PM (#39607727)
There is definitely interest in providing off-grid communities easy access to lightweight LLMs... one idea is to use something like: https://github.com/mlc-ai/web-llm to deliver it in a browser
Re:LibraryBox on Tuesday March 05, 2024 @01:51PM (#39607683)
ButterBox is a semi-spiritual successor to LibraryBox for RPis and similar hardware, and built in collab with the F-Droid project, to provide off-grid app store access (as well as chat, and general file service):

https://likebutter.app/box/ https://gitlab.com/likebutter/butterbox-rpi/-/blob/main/docs...

Except from a discussion with ChatGPT GPT4 using the interactive voice mode feature, while I was waiting at the airport for a delayed flight. Yes, that means I was walking around a public place talking to an AI. ... User Maybe we can roleplay where you pretend to be TARS and you call me Coop?

ChatGPT Absolutely, Coop. Ready to navigate through the stars or tackle any anomalies we encounter. What's our first mission?

User We have to navigate out to the black hole, I guess, to check that first planet out, right?

ChatGPT Roger that, Coop. Setting course for the black hole to approach the first planet. It's going to be a tricky maneuver, especially with the time dilation effect we need to consider. We'll need to be quick to minimize our time there and avoid losing too much time relative to Earth. Anything specific you want to prepare for before we make the jump?

User Uh, what's your, uh, humor level set at? ... More on reddit!

I had been working on an idea for an interface "Sorting Hat" system to help kids at schools know whether something was for trash, compost, or recycling. While I had been hacking on it for a bit, Greg's "demo" was much better integrated than what I could do, so thanks Greg!

I did add ElevenLabs support to make it a little more snazzy sounding...

So, here it is the "Compose/Trash/Recycle Sorting Hat, Built on Sagittarious" https://github.com/n8fr8/CompostSortingHatAI

You can see a realtime, unedited YouTube demo video of my kid testing it out here: https://www.youtube.com/watch?v=-9Ya5rLj64Q