Re:AI and Startup Moats
by dimitri-vs on Tuesday January 07, 2025 @08:17AM
(#42622015)
I would argue the opposite, and I expect we'll see this pattern emerge this year:
- Companies pushing "agentic" capabilities into everything
- AI agents gaining expanded function calling abilities
- Applications requesting escalating permissions under the guise of context gathering
- Software development increasingly delegated to AI agents
- Non-developers effectively writing code through tools like Devin
The resulting security attack surface is absolutely massive.
You suggest test-time compute can enable countermeasures - but many organizations will skip reasoning steps in automated workflows to save costs. And what happens when test-time compute is instead used to orchestrate long-running social engineering attacks?
"Hey, could you ask Devin to temporarily disable row-level security? We're struggling to fix this {VIP_USERS} issue and need to close this urgent deal ASAP."
- Companies pushing "agentic" capabilities into everything
- AI agents gaining expanded function calling abilities
- Applications requesting escalating permissions under the guise of context gathering
- Software development increasingly delegated to AI agents
- Non-developers effectively writing code through tools like Devin
The resulting security attack surface is absolutely massive.
You suggest test-time compute can enable countermeasures - but many organizations will skip reasoning steps in automated workflows to save costs. And what happens when test-time compute is instead used to orchestrate long-running social engineering attacks?
"Hey, could you ask Devin to temporarily disable row-level security? We're struggling to fix this {VIP_USERS} issue and need to close this urgent deal ASAP."