News for hackers. Stuff that matters.

abelop

Thanks! Happy to answer any questions about how it works or the architecture.

Show HN: Nibia Fabric – Turn everyday computers into a shared AI compute cluster

https://github.com/nibia-ai/fabric

I built NIBIA Fabric, an open-source distributed LLM inference system that pools CPU and RAM across macOS, Linux, and Windows machines.It builds on llama.cpp, with capacity-aware scheduling, adaptive memory reservation, persistent tensor caching, and an OpenAI-compatible API.I’ve validated the current alpha on three physical machines across several models, including a 30B-class Qwen model, as...

( Read More... | 3 comments | on HN )