News for hackers. Stuff that matters.

A comment on Trying out Gemini 3 Pro with audio transcription and a new pelican benchmark. Parent comment

Re:Trying out Gemini 3 Pro with audio transcription and a ne... by byt3bl33d3r on Tuesday November 18, 2025 @02:57PM (#45971208)
I’ve been meaning to create & publish a structured extraction benchmark for a while. Using LLMs to extract info/entities/connections from large amounts of unstructured data is also a huge boon to AI-assisted reporting and has also a number of cybersecurity applications. Gemini 2.5 was pretty good but so far I have yet to see an LLM that can reliably , accurately and consistently do this
[ Parent | on HN ]
Re:Trying out Gemini 3 Pro with audio transcription and a ne... by simonw on Tuesday November 18, 2025 @03:16PM (#45971462)
This would be extremely useful. I think this is one of the most commercially valuable uses of these kinds of models, having more solid independent benchmarks would be great.
[ Parent | on HN ]