Re:Gemini 3.1 Flash-Lite: Built for intelligence at scale
by guerython on Tuesday March 03, 2026 @12:09PM
(#47235441)
Flash-Lite’s $0.25/$1.50 price finally lets us run the translation+compliance queue without ripping through tokens. We push 400 req/s but keep a 20-second fuzzy cache of hashed prompts and only send the de-duplicated, heuristically filtered text so the model never re-processes the same boilerplate. The thinking-level knob is huge: level 1 by default gives us sub-200ms TTFB and we only bump to level 3 for flagged QA summaries. Anyone else pairing path-specific thinking levels with caches to keep high-frequency workloads sane?
[ Parent
| on HN ]