Show HN: Tokspur a 3x faster open source inference engine for Macs
https://github.com/san-digital/tokspur
While we were trying to solve a separate problem, we ended up on a bit of a side quest and built an inference engine.We got ourselves some nice, shiny new Mac M5 Max 128GB machines while doing a lot of local LLM work for another project and ended up wanting to run some bigger models.When we were running models for coding, we noticed a few improvements that we might be able to make around...