Re:Beating GPT-5.6 Sol on retrieval with 100x cheaper open m...
by podocarp on Thursday August 06, 2026 @05:34AM
(#49194491)
I don't think the big companies not making Sota models being an indicator that open source failed. If all semiconductor patents expired tomorrow it would still be prohibitively difficult to manufacture your own CPU at home or at work.
[ Parent
| on HN ]
Re:Beating GPT-5.6 Sol on retrieval with 100x cheaper open m...
by typ on Thursday August 06, 2026 @08:16AM
(#49195621)
Me neither. But open weights are not open source in the first place.
It wouldn't be surprising that the raw intelligence of an LLM model has little to do with the architecture (which is the part most published).
The secret sauce, like how/what data gets curated and cleaned, has rarely been talked about. So, even if the labs upload their weights, competitors are very difficult, if not impossible, to replicate the technology independently.