News for hackers. Stuff that matters.
Re:Compress any LLM 3x in one click,near-lossless,in under 5... by ElectricalUnion on Tuesday November 10, 2026 @09:03AM (#50440552)
What is the point of using a outright ancient model like DeepSeek-R1-Distill-1.5B from 2025 based on another ancient model like Qwen2.5-Math-1.5B from 2024, when a much better modern model like LFM3-1.7B exists?
Re:Compress any LLM 3x in one click,near-lossless,in under 5... by anushka_gandhi on Tuesday November 10, 2026 @09:08AM (#50440620)
We have tested it on all kinds of small models including LFM3-1.7B. Our goal is to make a a system that can compress any AI. This is our first version and with your feedback we can improve.
Re:Compress any LLM 3x in one click,near-lossless,in under 5... by NitpickLawyer on Tuesday November 10, 2026 @09:10AM (#50440641)
This is a well known tell for using (bad) models to do "research". They always use qwen2.5 and R1, because of the amount of "news" that the two models received. So the models "suggest" those lineages a lot. The local llama sub used to get a few of these a day. That and a zenodo "paper" link are clear tells of badly written stuff.
Re:Compress any LLM 3x in one click,near-lossless,in under 5... by dannyw on Tuesday November 10, 2026 @09:14AM (#50440682)
Although with Anthropic purposefully sandbagging their models for AI R&D, how much of it comes down to model failure, and how much of it comes to deliberate misalignment of the model maker and the customers they sell to?