News for hackers. Stuff that matters.

guanming0717

Re: on Wednesday September 23, 2026 @03:36PM (#49821374)
Runtime optimizations alone provide a 2–7× speedup with bitwise-exact outputs. SFew-step distillation provides another 4–5× speedup
Re: on Tuesday September 22, 2026 @03:40PM (#49806996)
ayyy was great to meet you :)
Yes I did, with other SOTA quant methods like HQQ, AWQ etc. You can find more info in our blog :) https://general-instinct.com/blog/frontier-moe-sub-4-bit
Thanks for sharing! I'd love to chat with him. Would you be open to introducing us? :)

Launch HN: General Instinct (YC P26) – Frontier models on edge devices

Hey HN, Guanming and Bill here from General Instinct (https://general-instinct.com/).After years of working in robotics, we kept running into the same problem: the best models never fit the hardware we actually had available.The models that performed best were usually designed around datacenter assumptions: large GPUs, lots of memory bandwidth, and reliable network access. But most physical...

( Read More... | 16 comments | 32 points | on HN )