News for hackers. Stuff that matters.

yujonglee

This incident is unrelated to what was committed to the repository. More info: https://docs.litellm.ai/blog/security-incident-oct-21-2026
Re:Litelm: LiteLLM Without the Bloat on Friday September 11, 2026 @07:51PM (#49667017)
- We recently migrated to shadcn, which also comes with dark mode support. - You can subscribe to the issue or email me at yujong at berri.ai

I’m happy to provide any support if you’re willing to try out the initial version.

Re:Litelm: LiteLLM Without the Bloat on Friday September 11, 2026 @06:59PM (#49666594)
thanks for the feedback. genuinely curious what you think we could be doing better, especially around our dev practices. Would love to hear specifics.
Re:Litelm: LiteLLM Without the Bloat on Friday September 11, 2026 @06:58PM (#49666579)
also if you had resource issues with your production deployment, keen to hear more details
Re:Litelm: LiteLLM Without the Bloat on Friday September 11, 2026 @06:57PM (#49666571)
hey - litellm will migrate its core to Rust soon. please follow this issue if you're interested! https://github.com/BerriAI/litellm/issues/31263
Re:Launch HN: Speko (YC S26) – OpenRouter for Voice AI on Monday August 17, 2026 @03:41PM (#49336512)
cool! we have something similar implemented: https://github.com/fastrepl/anarlog/tree/main/crates/owhispe...
amazing work! impressed with https://deepgrove.ai/chat

Show HN: Composable CLI for your meeting workflow

https://cli.char.com/

Hi, this is Yujong from Char (https://github.com/fastrepl/char).This CLI is a repackaging of the audio/transcription pipeline that powers our desktop app. We noticed that some people build lightweight CLIs to record conversations and send them to tools like OpenClaw or other agents for transcription and workflow automation, so we wanted to make this more accessible as a standalone tool.It...

( Read More... | no comments | on HN )
Super impressed and inspired!
kind of self-plug, but you might find https://github.com/fastrepl/hyprnote/blob/main/README.md interesting.

EDIT: typo

It can run Whisper and Moonshine models locally, while also allowing the use of other API providers. Read the docs - or at least this post.
what do you mean? this use-case is not llm. it is realtime stt.

also fyi - https://docs.hyprnote.com/owhisper/configuration/providers/o...

Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @10:20PM (#44907931)
sure. `owhisper pull --help`
Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @09:08PM (#44907568)
yes. metal is on
Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @08:34PM (#44907368)
Thank you!
Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @07:53PM (#44907103)
Its lot more than that.

- It supports other models like moonshine.

- It also works as proxy for cloud model providers.

- It can expose local models as Deepgram compatible api server

Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @07:51PM (#44907089)
probably end of this month or early next month. not 100% sure.
Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @07:51PM (#44907087)
we store data in R2 and range query sometime glitch... It might work if you retry it
Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @05:24PM (#44905874)
yeah we use whisper.cpp for whisper inference. this is more like a community-focused project, not a commercial product!
Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @05:19PM (#44905820)
got it. fyi if you run `owhisper pull --help`, this info is printed
Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @04:54PM (#44905593)
It's open-source. Happy to review & merge if you can send us PR!

https://github.com/fastrepl/hyprnote/blob/8bc7a5eeae0fe58625...

Re:Show HN: OWhisper – Ollama for realtime speech-to-text on Thursday August 14, 2025 @04:36PM (#44905400)
Are you thinking about the realtime use-case or batch use-case?

For just transcribing file/audio,

`owhisper run <MODEL> --file a.wav` or

`curl httpsL//something.com/audio.wav | owhisper run <MODEL>`

might makes sense.

Older »