News for hackers. Stuff that matters.
Re:Show HN: DeepSeek-V4 Latent Reasoning – moving "thinking"... by smallerize on Sunday August 09, 2026 @08:32AM (#49230837)
Cool idea. I didn't understand what causes the bad response on the first query. Does it mean the first response in every new conversation, or just the first served response after startup?
Re:Show HN: DeepSeek-V4 Latent Reasoning – moving "thinking"... by nmitchko on Sunday August 09, 2026 @10:44AM (#49231894)
After vLLM startup I observed this on first request only then all further conversations were fine, new and original. Can’t figure out why but seems to be fine after that.