Re:Show HN: Local task classifier and dispatcher on RTX 3080...
by superactro on Tuesday February 10, 2026 @12:42AM
(#46955816)
Really cool project. The offline-first approach for field computing is something I've been thinking about a lot.
We built something adjacent — ClawBox (https://openclawhardware.dev) is a pre-configured Jetson Orin Nano box meant to be an always-on AI assistant for home/office. Different use case (always-on personal assistant vs. field computer) but similar philosophy: local-first, no cloud dependency, everything runs on-device.
One thing we found is that having 40 TOPS of AI compute on an ARM SoC at ~15W opens up capabilities that people don't expect from small hardware. Running 7B parameter models locally, doing browser automation, managing multi-platform messaging — all without ever calling an API.
How are you handling model serving on the device? Curious if you've looked at running something like llama.cpp with the Jetson's GPU acceleration, since your modular approach could work really well with different compute modules.
We built something adjacent — ClawBox (https://openclawhardware.dev) is a pre-configured Jetson Orin Nano box meant to be an always-on AI assistant for home/office. Different use case (always-on personal assistant vs. field computer) but similar philosophy: local-first, no cloud dependency, everything runs on-device.
One thing we found is that having 40 TOPS of AI compute on an ARM SoC at ~15W opens up capabilities that people don't expect from small hardware. Running 7B parameter models locally, doing browser automation, managing multi-platform messaging — all without ever calling an API.
How are you handling model serving on the device? Curious if you've looked at running something like llama.cpp with the Jetson's GPU acceleration, since your modular approach could work really well with different compute modules.