News for hackers. Stuff that matters.

A comment on Show HN: We made our own inference engine for Apple Silicon.

Re:Show HN: We made our own inference engine for Apple Silicon by rnxrx on Tuesday July 15, 2025 @11:22AM (#44572115)
I'm curious about why the performance gains mentioned were so substantial for Qwen vs Llama?
[ Parent | on HN ]
Re:Show HN: We made our own inference engine for Apple Silicon by AlekseiSavin on Tuesday July 15, 2025 @12:03PM (#44572574)
it looks like llama.cpp has some performance issues with bf16
[ Parent | on HN ]