Show HN: EdgeAI-OS – Air-gapped Linux distro where AI is a system primitive
The problem: Most AI requires cloud APIs, which means your data leaves your control. For banks, healthcare, defense, and regulated industries – that's a non-starter.
The solution: EdgeAI-OS runs everything locally. No cloud calls. No API keys. No telemetry. Boot the ISO, use AI. Your data never leaves the machine.
Security features: - 100% offline operation – air-gap friendly, zero network dependencies - No external API calls – all inference runs locally on CPU - Command risk assessment – every command classified as Safe/Moderate/Dangerous - Dangerous pattern blocking – prevents rm -rf /, curl|bash, fork bombs, etc. - Open source & auditable – MIT licensed, inspect every line of code - No data exfiltration – nothing phones home, ever
What's in the ISO: - Local LLMs (TinyLlama 1.1B + SmolLM 135M) – runs on CPU, no GPU needed - ai-sh: natural language shell where 80% of queries resolve instantly via templates - Multi-tier routing: simple queries → fast model, complex → larger model
Example ai-sh session: what time is it? [template] date ← instant, no LLM
files larger than 1gb [template] find . -size +1G ← instant, no LLM
rm -rf / [DANGEROUS] Blocked ← security check
configure nginx as reverse proxy [ai-generated] ... ← uses local LLM (~1-2s)
Target use cases: - Air-gapped enterprise environments (banks, healthcare, government) - Defense & classified networks - Edge devices with no internet connectivity - Privacy-conscious developers - Compliance-heavy industries (HIPAA, GDPR, SOC2)
Built with Rust, based on Debian. 4GB RAM recommended.
GitHub: https://github.com/neuralweaves/edgeai-os ISO Download: https://github.com/neuralweaves/edgeai-os/releases (1.2GB)
Would love feedback, especially from anyone working in secure/regulated environments. What features would make this enterprise-ready for you?
I took a different but complementary approach with ClawBox (https://openclawhardware.dev) — instead of an OS, it's a pre-configured hardware box (Jetson Orin Nano + NVMe SSD) that ships with everything ready to go. Plug it in, connect to your network, and you have a local AI assistant running 24/7 at ~15W.
The insight I keep coming back to: most people don't want to configure a Linux distro or set up model serving — they want something that "just works" like a router. Your approach of making the OS handle AI as a system primitive is really interesting for the technical crowd though.
Question: have you considered supporting GPU-accelerated inference? TinyLlama on CPU is functional but the experience gap vs. running even a 7B model on a Jetson or similar SoC is massive. 40 TOPS of dedicated AI compute changes what's practical at the edge.
v0.2: Daemon stability, metrics v0.3: ARM64 support (Raspberry Pi) v0.4: GPU acceleration
It will be available soon.
Question back: How are you handling model updates on ClawBox? One challenge I see with appliances is keeping models current without requiring internet access. Curious how you're solving that for air-gapped deployments.