News for hackers. Stuff that matters.

jmrobles

Hi HN! I built Autocache, an intelligent proxy for the Anthropic Claude API that automatically reduces costs by up to 90% and latency by up to 85%.

  **The Impact:**
  If you're spending $100/day on Claude API calls with system prompts and tools, Autocache can reduce that to ~$10/day with zero code changes. For a 1000-token system prompt reused across requests, you pay 1.25× once to cache it, then 0.1× on every
  subsequent request.

  **The Problem:**
  Anthropic's Prompt Caching requires manually placing cache breakpoints in your API requests. For applications like n8n workflows, Flowise chatbots, or any complex integration with system prompts, tools, and conversation history, you either can't
  access the request structure to optimize it, or doing so manually is extremely tedious.

  **How Autocache Works:**
  It's a transparent drop-in proxy. For each request, it:
  1. Analyzes token counts across system prompts, tools, and message content
  2. Calculates ROI scores for potential cache breakpoints (write costs vs. read savings)
  3. Automatically injects cache-control fields at optimal positions
  4. Returns X-Autocache-* headers showing projected savings and break-even points

  **Perfect for:**
  - n8n AI workflows (change base URL in Claude node)
  - Flowise chatbots (configure HTTP endpoint)
  - LangChain/LlamaIndex apps
  - Custom Claude integrations
  - Any app where you can't manually optimize prompts

  **Try it in 30 seconds:**
  ```bash
  docker run -d -p 8080:8080 -e ANTHROPIC_API_KEY=sk-ant-... ghcr.io/montevive/autocache:latest

  Point your app to http://localhost:8080/v1/messages – check response headers for actual savings metrics on your workload.

  GitHub: https://github.com/montevive/autocache

  I've tested this with n8n workflows and seen $200→$25/day cost reductions on production workloads. The ROI algorithm uses conservative estimates, but I'd love feedback on edge cases or strategies I haven't considered.

  Tech: Go, ~29MB Docker image, multi-arch, MIT licensed.

Show HN: Penpot MCP Server

https://github.com/montevive/penpot-mcp

Hey HN!Excited to introduce Penpot MCP—a server designed to bridge the gap between design and development. Seamlessly integrate AI models with Penpot to automate the design-to-code process.Penpot is awesome, a true Figma open-source alternative with interesting features such as W3C standards and design tokens in the core.Configure Cursor IDE: Add to your Cursor config: { "mcpServers": { ...

( Read More... | no comments | on HN )
Re:Ask HN: Must-Read Books for Startups? on Sunday September 15, 2024 @03:51AM (#41545956)
"Fall in love with the problem and not the solution", Uri Levine (founder of Waze and Moovit)
Re:OpenAI announces leadership transition on Saturday November 18, 2023 @01:41AM (#38316231)
It sounds a new "Coca-cola" and "Pepsi" story again...
Re:Elixir for Humans Who Know Python on Saturday February 25, 2023 @02:36PM (#34939695)
No typing, no party.

...but I will include it under almost-low-code section

Re:John Carmack on Functional Programming in C++ (2018) on Saturday February 18, 2023 @05:45AM (#34845836)
The problem is even bigger when you are reviewing PRs, the lack of context is the big problem,imo.
IMHO it would be a vulnerability if you can "defeat" TLS with non-root user (scale priv attack). AFAIK you must be root to run tracing BPF.

As you say, quarkslab's tool (Peetch) can be a user-friendly alternative to Wireshark and SSL logs workaround.

It's awesome and open source!

I made this video comparison between GoPro6 4k video vs the stabilized with gyroflow

https://youtu.be/KWiqF8Z8lEg

Re:IoT Smart Lock Vulnerability Spotlights Bigger Issues on Monday August 10, 2020 @04:03AM (#24106736)
This is the funny part:

"the [cloud] server does have strong security” --> oh, good

"and that users’ data have been encrypted by the MD5 algorithm --> WTF???

Thanks brudgers.

This tutorial explains what it is and how it is used.

https://digitalilusion.com/news/become-an-expert-in-business...

Older »