News for hackers. Stuff that matters.

ashu_trv

Show HN: I packaged decade of video infra battle scars into tools for AI agents

Hi HN,I’m Ashu, founder of VideoDB. I’ve spent a big chunk of my life building video infrastructure. Not video creation. Video plumbing.The stuff you only learn after production breaks: timebases, VFR, keyframes, audio sync drift, container quirks, partial uploads, live streams, retries, backpressure, codecs, ffmpeg flags, cost blowups, and “why is this clip unseekable on one player but fine on...

( Read More... | no comments | 5 points | on HN )
I agree. I am big fan of o3, and GPT 5 is not the same, it's like going back to GPT-3 level stupidity. It doesn't care about context, feels super dumb.
What's really impressive here:

Model-Agnostic Infrastructure: Any AI model—open-source, proprietary, LLM, or VLM—can instantly gain real-time vision capabilities. No more waiting for Google to open their doors.

Immediate Availability: Unlike Project Astra, which is still behind Google's beta gates, VideoDB is usable today. Anyone can plug into the API, SDK, or cloud console immediately.

Openness and Developer-Friendliness: Seamless integrations with popular AI tools and frameworks like LlamaIndex, LangChain, and Hugging Face dramatically reduce the barrier to entry. Just a few lines of code and you're live.

Lessons Learned Building MCP for Video Infrastructure Startup

Hey HN,We've been deeply immersed in building chat-based video interactions for nearly two years.We recently launched VideoDB MCP as a practical exploration of MCP capabilities, and while there's plenty we're excited about, we've hit a bunch of interesting challenges along the way. We wanted to openly share some learnings with this community and invite discussion.1. Friction Is a KillerManual...

( Read More... | no comments | on HN )
Yeah, we tried to solve the 1 and 3. 2nd is still an open problem. Can you share more about the MECE?
Keeping documentation and SDK updates aligned with evolving "LLM contexts" can quickly overwhelm dev teams. At VideoDB, we've built an open-source solution—Agent Toolkit—that automates syncing your docs, SDK versions, and examples, making your dev content effortlessly consumable by Cursor, Claude AI, and other agents. Ready-to-use template available.

Underwhelming MCP vs Hype

My early thoughts on MCPs :As I see the current state of hype, the experience is underwhelming:Confusing targeting — developers and non devs both.For devs — it’s straightforward coding agent basically just llm.txt , so why would I use MCP isn’t clear.For non devs — It’s like tools that can be published by anyone and some setup to add config etc. But the same stuff has been tried by ChatGPT GPTs...

( Read More... | 16 comments | 2 points | on HN )
A new benchmark study evaluates Vision-Language Models (Claude-3, Gemini-1.5, GPT-4o) against traditional OCR tools (EasyOCR, RapidOCR) for extracting text from videos. The findings show VLMs outperforming OCR in many cases but also highlight challenges like hallucinated text and handling occluded/stylized fonts.

The dataset (1,477 manually annotated frames) and benchmarking framework are publicly available to encourage further research.

Paper: https://arxiv.org/abs/2502.06445 Dataset & Repo: https://github.com/video-db/ocr-benchmark

Would love to hear thoughts from the community on the future of VLMs in OCR.

Re:Show HN:Video is hard: until now on Wednesday December 04, 2024 @01:05PM (#42320149)
Thanks! Added now.
Re:Show HN:Video is hard: until now on Wednesday December 04, 2024 @12:50PM (#42319964)
This open-source agent framework is like ChatGPT, but for videos. It simplifies complex video tasks like search, editing, compilation, and—best of all—generation. The results stream instantly. You can even extend the agents to suit your needs and build custom automated workflows.

The framework is fully open source and uses a VideoDB key for cloud-based video storage, processing, and streaming. It seamlessly integrates with tools like Stable Diffusion, Eleven Labs, Kling, Replicate, and more.

Looking for collaboration with GenAI audio/ video teams and feedback from amazing devs out here.

Re:Show HN: Instantly create video clips from LLM prompts on Friday February 23, 2024 @10:21AM (#39481643)
It analyse the transcript, but there is no way to get back the video clip without building your own video infra. We at Videodb are solving the exact problem.
Re:Show HN: Instantly create video clips from LLM prompts on Friday February 23, 2024 @09:49AM (#39481196)
LLMs are great with text, but they don't help you consume or create video clips. Checkout PromptClip - Use natural language to describe the what you want. - Instantly get video clips with the help of LLMs like OpenAI or Claude.

Few interesting prompts we tried while building it and loved the results. There's no limit to creativity with this.

*Shark Tank Videos:* [Find every moment where a deal was offered](https://console.videodb.io/player?url=https://stream.videodb...)

*Useful Gadgets* [Show me where the host discusses or reveals the pricing of the gadget](https://console.videodb.io/player?url=https://stream.videodb...)

*Huberman Podcast:* [Find details about every sponsor](https://console.videodb.io/player?url=https://stream.videodb...)

*Masterchef* [Show me the feedback from every judge](https://console.videodb.io/player?url=https://stream.videodb...)

Say goodbye to manual editing, skimming and seeking the video and hello to instant, AI-driven video consumption and creation

Re:Show HN: Instantly create video clips from LLM prompts on Friday February 23, 2024 @09:48AM (#39481183)
Yeah, VideoDB is the next-gen infrastructure for videos and actually less costly than current video infrastructure.

But you can use any LLM for analysing the transcript.

Re:Show HN: GPT-Powered Video Retrieval and Streaming on Thursday February 08, 2024 @06:09AM (#39300615)
Build custom GPT on your video data with StreamRAG in 2 mins.This search agent find relevant moments across hundreds of hours of content and return a video clip instantly.

RAG applications are great with text, but with video they can't support simple requests like "show me where sleep improvement is discussed"

Made a twitter bot that lets you generate an interactive transcript(Spext Docs) of any audio/video in a tweet

Here is an example - https://twitter.com/spext_it/status/1286130139290632192

Interactive transcripts are published at https://publish.spext.co

Very cool! How is it going to be beneficial over the native solutions provided by cloud providers itself?

Older »