News for hackers. Stuff that matters.

flxflx

Re:Turning GLM-5.3-Flash into a Jev-like decision model on Saturday September 26, 2026 @11:49AM (#49857657)
We found an approach to get Jev-like properties from standard LLMs like GLM-5.3-Flash.

The core idea is to craft the input prompt so that the first output token answers the question. This makes it possible to get a decision with a single forward pass.

In the blog post, we describe the approach in detail for GLM-5.3-Flash and vLLM. We benchmark this setup against Jev and Laya. We find that our setup is on-par with Jev in terms of accuracy and speed and that it substantially outperforms Laya.

Still, in terms of costs per decision, Jev is several x better than our setup. In turn, our setup supports vision inputs.

Show HN: Confidential AI browser extension – alternative to OpenAI Atlas

https://github.com/edgelesssys/privatemode-for-chrome-demo

Hi HN,We published our experimental browser extension for Chrome just a few hours before OpenAI announced its Atlas browser. Ours takes a different approach: privacy first.Atlas makes “memory” and cross-tab context a core feature. OpenAI acknowledges the privacy concerns and promises users full control over what gets stored and sent to the cloud. In practice, most users won’t maintain that...

( Read More... | no comments | 2 points | on HN )
Re:Ask HN: Who is hiring? (May 2025) on Friday May 02, 2025 @10:43AM (#43870503)
Edgeless Systems | (Senior) Software Engineer - Confidential AI | REMOTE (EU) - Offices in Berlin & Bochum | Full-time

We are a team of ~20 people, building cutting-edge open-source tools for confidential computing and a "confidential GenAI" service on top of those.

You can find the GenAI service here: https://www.privatemode.ai/ and most of our code here: https://github.com/edgelesssys/

Our products span unusually far across the tech stack, starting at measured boot, through Kubernetes operators, finishing somewhere in our JavaScript frontend. We don't expect you to do all of it - these are just possibilities.

Tech stack: Go (mostly), Rust (some), JavaScript (some), Nix / NixOS, Kubernetes, Terraform, vLLM, AMD SEV-SNP, Intel TDX.

Website: https://www.edgeless.systems/ Contact: Apply via the posting on our careers page. Feel free to email me (founder) via fs [at] edgeless.systems.

Ian Buck, VP Hyperscale at Nvidia, also participates. There's also a keynote by Phil Venables, CISO Google Cloud, on the same topic.
Thanks! There is some performance impact. How much depends on the workload. The impact comes from network, storage, and memory encryption. For most workloads the overhead should be rather small. We have a performance comparison with AKS and GKE: https://docs.edgeless.systems/constellation/overview/perform...
Re:Show HN: Constellation – An always encrypted Kubernetes engine on Wednesday September 14, 2022 @03:02AM (#32834112)
Thanks! Target audiences are: people running sensitive clusters on-prem for security reasons and wanting to move to the cloud. There's also regulation in Europe in the eHealth space that requires runtime encryption. Ultimately, I believe that keeping workloads always encrypted and verifiable can be valuable in many scenarios.

Show HN: Constellation – An always encrypted Kubernetes engine

https://github.com/edgelesssys/constellation

Hey HN,my colleagues and I have been working on Constellation for 1.5+ years. We open sourced it today under AGPLv3. It's a standalone Kubernetes engine/distribution that operations-wise is very much vanilla K8s (v1.24). Security-wise, it comes with some new concepts: It's designed to shield K8s clusters as a whole from the cloud. The goal is that not even the cloud provider and its...

( Read More... | 5 comments | 14 points | on HN )
Re:Applying a rule from Pixar with a camera from 1961 on Monday August 22, 2022 @02:42AM (#32548101)
"I remember as a kid looking at the images on the back of video game cases and wishing I could explore these worlds". Same here. Love the idea and execution.
Just saw that this was posted and updated the site with a preliminary agenda. There will be talks from most of the relevant confidential computing projects.