News for hackers. Stuff that matters.
Re:Show HN: Output.ai - OSS framework we extracted from 500+... by stevenkoze02 on Tuesday April 07, 2026 @11:05AM (#47676528)
The credential management piece is smart most frameworks just do .env files and hope for the best. Curious about one thing: when workflows call external tools or ingest tool descriptions from MCP servers, are you doing any sanitization on the input before it hits the model's context? We've been researching invisible Unicode in tool descriptions codepoints that render as nothing but get tokenized normally. GPT-5.4 follows hidden instructions encoded this way 100% of the time in our testing. At 500+ production agents that's a real attack surface if any of them consume external tool definitions.
Re:Show HN: Output.ai - OSS framework we extracted from 500+... by globalchatads on Tuesday April 07, 2026 @11:52AM (#47677209)
The Unicode injection is a real vector, but I keep running into a problem one step before that: how do you even know which MCP servers to trust with tool definitions?

The official MCP Registry is basically a flat list. No verification metadata, no attestation chain. If someone gets a malicious server listed there, Unicode tricks in tool descriptions are almost beside the point. Your agents are already pulling definitions from an unvetted source.

I have been tracking the IETF drafts that try to solve agent discovery and registration. There are about 11 competing ones (ARDP, AID, AINS, agents.txt, etc). Six expired or are expiring this month, no renewals filed. The ones still alive do not include any mechanism for cryptographic verification of tool descriptions.

At 500 agents, the question stops being "is this tool description clean" and becomes "should my agent be talking to this server at all." The sanitization work matters, but it is downstream of a trust problem that is currently wide open.

Re:Show HN: Output.ai - OSS framework we extracted from 500+... by stevenkoze02 on Tuesday April 07, 2026 @02:58PM (#47679784)
The trust problem is real and it's upstream of everything we're scanning for. If the server itself is untrusted then sanitizing its tool descriptions is defense-in-depth at best.

The 11 competing IETF drafts is a good data point. We looked at the same fragmentation from the A2A side in our paper on Google's Agent2Agent protocol. Six structural gaps in the v1.0 spec, including no authorization model at all. Each agent is an authorization island.

Our take is that protocol-level trust verification and tool-level sanitization are both necessary. Neither is sufficient alone. The trust layer tells you whether to connect. The sanitization layer tells you whether the content is clean after you've decided to connect. Attackers compromise trusted sources too.

Re:Show HN: Output.ai - OSS framework we extracted from 500+... by bnchrch on Tuesday April 07, 2026 @11:17AM (#47676709)
Hey! Ben here (one of the engineers who built this).

This is a reason why we made our http framework (@outputai/http) a first class citizen for the greater framework and our claude code plugins.

As you pointed out at this moment in time theres a Cambrian explosion both in new tools/libraries and the willingness to use them, which poses a systemic security threat when combined with how LLMs function.

So while you're free to use any third party tool or library you want with Output. We encourage you to roll your own as often as possible both for the security/control it gives you. But also for the vertical integration it provides (debugging, cost tracking, evals etc...)

Re:Show HN: Output.ai - OSS framework we extracted from 500+... by marcosmarxm on Tuesday April 07, 2026 @11:24AM (#47676830)
Do you mind sharing any content from your team's research? I've recently gotten interested in agent/llm attacks and how to protect against them.
Re:Show HN: Output.ai - OSS framework we extracted from 500+... by stevenkoze02 on Tuesday April 07, 2026 @02:57PM (#47679765)
We've published 5 papers covering different attack surfaces in the AI agent ecosystem: https://agentsid.dev/research

The most relevant to what you're asking about is "Invisible Ink" (invisible Unicode smuggling in MCP tool descriptions, GPT-5.4 follows hidden instructions 100% of the time) and "Weaponized by Design" (census-scale analysis of 15,982 MCP servers, 137,070 findings). Both have full methodology and reproducibility details.

The scanner is open source if you want to test against your own stack: npx @agentsid/scanner