iv42
Re:Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s...
on Monday August 17, 2026 @03:02PM (#49335987)
I don't have a 5090, so I can't really comment, but here's the relevant reddit thread from today where they report the numbers (including ninfer ones), and where you can make your case:
https://www.reddit.com/r/LocalLLaMA/comments/1vqjeub/how_man...
Re:Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s...
on Monday August 17, 2026 @12:11PM (#49333341)
If you've got RTX 5090, maybe try ninfer (https://github.com/Neroued/ninfer). Folks over on /r/localllama have been reporting wild prefill/token gen speeds with ninfer (NVFP4; 256k ctx).
Re:Ghidra by NSA
on Tuesday February 17, 2026 @12:49AM (#47044159)
Re:Why SQLite Is Taking over with Brian Holt and Marco Bambini
on Wednesday June 12, 2024 @04:58AM (#40656012)
I was kinda wondering too, and did a (very shallow) dive into the JavaScript on that page. I'm almost positive they are using Deepgram(dot com)'s speech-to-text service.
I ran whisper.cpp on that audio file on my laptop, and it does a reasonably well job too.
Re:The Magical Mystery Merge Or Why we run FreeBSD-current at Netflix ...
on Monday June 10, 2024 @06:27AM (#40632023)
Yes. Because sendfile(2) is not zero-copy on ZFS.
Re:Chrome still hasn't changed its opinion about dropping JPEG XL support
on Tuesday June 06, 2023 @12:30PM (#36215312)
and here's one: https://github.com/niutech/jxl.js
Re:The Slotted Counter Pattern
on Monday August 01, 2022 @02:49PM (#32310484)
Also, it's basically identical to the pattern described as Counter Tables in "High Performance MySQL" (3rd edition), published in 2012.
Re:A tool to render and upscale Sierra adventure game background images
on Sunday May 29, 2022 @09:51AM (#31549120)
Yep, it's from the first one. Manhunter: New York.
Re:FreeBSD has serious problems with focus, longevity and lifecycle (2...
on Tuesday January 25, 2022 @06:22AM (#30070606)
Linux, as part of integration with Facebook's infrastructure: https://news.ycombinator.com/item?id=22028689
Re:Electric shocks to the tongue can quiet chronic ringing ears
on Thursday October 08, 2020 @03:57AM (#24716937)
Standard audiometry, usually, only produces a test that goes up to 8 kHz (functional speech recognition). An extended high frequency audiometry may, or may not be more revealing as it can go higher. It would have no bearing on your medical treatment though.
Re:The Zen of Go
on Sunday February 23, 2020 @08:45AM (#22396790)
Yes, it does: -Werror=unused-variable
Re:"Google Stadia is not a product that exists because people want it"
on Tuesday November 19, 2019 @10:55AM (#21574240)
https://projectstream.google.com/speedtest
Bandwidth test only though; latency not reported.
Re:Installing Debian Linux 2.0 (1998)
on Monday August 26, 2019 @04:20PM (#20803352)
Re:My home lab setup for highly-available Internet
on Tuesday July 03, 2018 @04:04PM (#17453230)