News for hackers. Stuff that matters.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by flippyhead on Tuesday January 21, 2025 @05:12PM (#42785739)
I have a tiny device that listens to conversations between two people or more and constantly tries to declare a "winner"
Re:Ask HN: Is anyone doing anything cool with tiny language ... by mkaic on Tuesday January 21, 2025 @07:27PM (#42787108)
This reminds me of the antics of streamer DougDoug, who often uses LLM APIs to live-summarize, analyze, or interact with his (often multi-thousand-strong) Twitch chat. Most recently I saw him do a GeoGuessr stream where he had ChatGPT assume the role of a detective who must comb through the thousands of chat messages for clues about where the chat thinks the location is, then synthesizes the clamor into a final guess. Aside from constantly being trolled by people spamming nothing but "Kyoto, Japan" in chat, it occasionaly demonstrated a pretty effective incarnation of "the wisdom of the crowd" and was strikingly accurate at times.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by eddd-ddde on Tuesday January 21, 2025 @06:41PM (#42786672)
I love that there's not even a vague idea of the winner "metric" in your explanation. Like it's just, _the_ winner.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by oa335 on Tuesday January 21, 2025 @05:18PM (#42785791)
This made me actually laugh out loud. Can you share more details on hardware and models used?
Re:Ask HN: Is anyone doing anything cool with tiny language ... by jjcm on Tuesday January 21, 2025 @05:37PM (#42785979)
Are you raising a funding round? I'm bought in. This is hilarious.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by econ on Tuesday January 21, 2025 @05:34PM (#42785949)
This is a product I want
Re:Ask HN: Is anyone doing anything cool with tiny language ... by hn8726 on Tuesday January 21, 2025 @06:17PM (#42786455)
What approach/stack would you recommend for listening to an ongoing conversation, transcribing it and passing through llm? I had some use cases in mind but I'm not very familiar with AI frameworks and tools
Re:Ask HN: Is anyone doing anything cool with tiny language ... by pseudosavant on Tuesday January 21, 2025 @05:17PM (#42785781)
I'd love to hear more about the hardware behind this project. I've had concepts for tech requiring a mic on me at all times for various reasons. Always tricky to have enough power in a reasonable DIY form factor.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by amelius on Tuesday January 21, 2025 @05:36PM (#42785970)
You can use the model to generate winning speeches also.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by nejsjsjsbsb on Tuesday January 21, 2025 @09:28PM (#42788174)
All computation on device?
Re:Ask HN: Is anyone doing anything cool with tiny language ... by prakashn27 on Tuesday January 21, 2025 @11:14PM (#42788937)
wifey always wins. ;)
Re:Ask HN: Is anyone doing anything cool with tiny language ... by deivid on Wednesday January 22, 2025 @01:51AM (#42789840)
what model do you use for speech to text?
Re:Ask HN: Is anyone doing anything cool with tiny language ... by TechDebtDevin on Wednesday January 22, 2025 @06:47AM (#42791711)
Your SO must really love that lmao
Re:Ask HN: Is anyone doing anything cool with tiny language ... by econ on Thursday January 23, 2025 @03:04PM (#42807514)
Tell me it also does sports style commentary on the ongoing debate. My mental image requires it.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by flippyhead on Friday January 31, 2025 @01:54PM (#42890452)
Heh, I made this comment and forgot to check back -- I'm always missing stuff on HN because of this!

If anyone is still paying attention, email me at [email protected] and I'll see if I can send you one.

Re:Ask HN: Is anyone doing anything cool with tiny language ... by Shonku_ on Saturday February 08, 2025 @05:29AM (#42981978)
Yeah I'm still paying attention!
Re:Ask HN: Is anyone doing anything cool with tiny language ... by ultrasounder on Sunday February 09, 2025 @12:59PM (#42992234)
Sounds cool! In fact, this can be applied to other areas such as "debate monitoring" for debate competitions