News for hackers. Stuff that matters.
Re:Claude Opus 4.8 by harsh3195 on Thursday May 28, 2026 @02:00PM (#48312906)
You can find them on Deepinfra. Palo Alto company. Similar cheap price.
[dead]
Re:Claude Opus 4.8 by wirybeige on Thursday May 28, 2026 @04:39PM (#48315145)
DS4 Pro/Flash were post trained with QAT, so they are already quantized to FP4 for the most part. That's why when downloading the weights, they are much smaller than what their weights at fp8 or fp16 would be. For example, Flash is a 284B model, but its GB size is only ~160GB. OFC maybe DeeppInfra went even further, but there is no proof of that.
Re:Claude Opus 4.8 by pants2 on Friday May 29, 2026 @12:02AM (#48318880)
Interesting then that OpenRouter[1] tags many providers as FP8 and DeepInfra as FP4.

1. https://openrouter.ai/deepseek/deepseek-v4-pro

Re:Claude Opus 4.8 by wirybeige on Friday May 29, 2026 @12:49PM (#48325793)
I presume the providers are the ones giving the info to OpenRouter? I mean, technically it is a mix of fp8 and fp4 (although it is predominately fp4), so I don't think either is inaccurate.