News for hackers. Stuff that matters.

defilan

They definitely all play off emotions and have their own way to tapping into addictive behaviors. Youtube doom scrolling, reading endless reddits, etc. Lots of apps trying to get you hooked.
I totally agree. Is a local model running on your laptop going to outperform the latest frontier model? No, but that's not the point. Many of the use cases folks have can be done well with these newer smaller models. What amazes me is that these keep getting better with existing hardware you have. It's been fun to benchmark and test as these keep coming out.

Show HN: LLMKube – Kubernetes for Local LLMs with GPU Acceleration

https://github.com/defilantech/LLMKube

Hi HN! I built LLMKube, a Kubernetes operator for deploying GPU-accelerated LLMs in production. One command gets you from zero to inference with full observability.Why this exists: Regulated industries (healthcare, defense, finance) need air-gapped LLM deployments, but existing tools are either single-node only (Ollama) or lack GPU optimization and SLO enforcement. LLMKube bridges the...

( Read More... | no comments | 5 points | on HN )
Re:New 13-inch MacBook Pro on Monday May 04, 2020 @02:29PM (#23071544)
As a VIM guy myself, this was huge. I never felt like I was missing out having done this.