flxflx
The core idea is to craft the input prompt so that the first output token answers the question. This makes it possible to get a decision with a single forward pass.
In the blog post, we describe the approach in detail for GLM-5.3-Flash and vLLM. We benchmark this setup against Jev and Laya. We find that our setup is on-par with Jev in terms of accuracy and speed and that it substantially outperforms Laya.
Still, in terms of costs per decision, Jev is several x better than our setup. In turn, our setup supports vision inputs.
Show HN: Confidential AI browser extension – alternative to OpenAI Atlas
https://github.com/edgelesssys/privatemode-for-chrome-demo
Hi HN,We published our experimental browser extension for Chrome just a few hours before OpenAI announced its Atlas browser. Ours takes a different approach: privacy first.Atlas makes “memory” and cross-tab context a core feature. OpenAI acknowledges the privacy concerns and promises users full control over what gets stored and sent to the cloud. In practice, most users won’t maintain that...
We are a team of ~20 people, building cutting-edge open-source tools for confidential computing and a "confidential GenAI" service on top of those.
You can find the GenAI service here: https://www.privatemode.ai/ and most of our code here: https://github.com/edgelesssys/
Our products span unusually far across the tech stack, starting at measured boot, through Kubernetes operators, finishing somewhere in our JavaScript frontend. We don't expect you to do all of it - these are just possibilities.
Tech stack: Go (mostly), Rust (some), JavaScript (some), Nix / NixOS, Kubernetes, Terraform, vLLM, AMD SEV-SNP, Intel TDX.
Website: https://www.edgeless.systems/ Contact: Apply via the posting on our careers page. Feel free to email me (founder) via fs [at] edgeless.systems.
CTOs of Azure, AMD, and Intel Discussing "Confidential AI" at OC3 Conference
Confidential Computing at Scale with Open-Source Confidential Kubernetes
Google announced secure data sharing based on confidential computing
Show HN: Constellation – An always encrypted Kubernetes engine
https://github.com/edgelesssys/constellation
Hey HN,my colleagues and I have been working on Constellation for 1.5+ years. We open sourced it today under AGPLv3. It's a standalone Kubernetes engine/distribution that operations-wise is very much vanilla K8s (v1.24). Security-wise, it comes with some new concepts: It's designed to shield K8s clusters as a whole from the cloud. The goal is that not even the cloud provider and its...