Re:Nvidia DGX Spark encrypted firmware slows inference speed...
by alerighi on Wednesday November 04, 2026 @06:41AM
(#50364252)
Because maybe you don't want to send your private data to a company that could use it for whatever it wants?
[ Parent
| on HN ]
Re:Nvidia DGX Spark encrypted firmware slows inference speed...
by barrkel on Wednesday November 04, 2026 @08:13AM
(#50365095)
Can you explain what data is going where?
Re:Nvidia DGX Spark encrypted firmware slows inference speed...
by entrope on Wednesday November 04, 2026 @08:39AM
(#50365363)
Your prompts and whatever data they collect from your dev environment go to the inference provider, and typically the customer has neither control nor assurance over what the inference provider (re-)uses that data for.
Re:Nvidia DGX Spark encrypted firmware slows inference speed...
by Orygin on Wednesday November 04, 2026 @10:52AM
(#50367364)
Your prompts and data are going through your own VPN to your own inference hardware. You did not read the post apparently
Re:Nvidia DGX Spark encrypted firmware slows inference speed...
by anonym29 on Wednesday November 04, 2026 @08:46AM
(#50365445)
GP isn't proposing using closed proprietary models over an API, they're proposing having local hardware serving open weight models at your house/apartment being remotely accessible through an overlay network like Tailscale. The idea being that local inference is very hungry for power and thermal budget, so you run the inference somewhere that power and thermal headroom is abundant (your house/apartment, on a tower, or dedicated unified memory boxes like DGX Spark, Strix Halo, Mac Studio, etc) and then remotely utilize that inference from a regular laptop. You still get all of the benefits of local, private AI inference, without having to expend a laptop's limited power and thermal budget on doing the inference on the laptop itself.