I built AptSelect to stop writing throwaway scripts every time I needed to test how different LLMs handle specific instructions and prompt edge cases.What it does:Parallel Execution: Send a single prompt to OpenAI, Anthropic, Mistral, and Gemini simultaneously. Compare the outputs, latency, and exact token usage side-by-side.Batch Evaluations: Upload a CSV dataset to run bulk tests across...
Hi HN,Whenever I needed an LLM to reliably output JSON or follow strict formatting rules, I kept having to write throwaway JavaScript scripts just to test the same prompt against OpenAI, Anthropic, and Google APIs to see who actually followed the instructions. It was a tedious workflow, so I built a local desktop UI to just do it for me.What it does:* Sends one prompt to OpenAI, Anthropic,...
And whenever a fix or patch feel like a duct-tape to me, start looking at the architecture and keep asking myself how can this be refactor to make it more resilient.
I realized my brain naturally wants to 'fill in the gaps' with assumptions. Learning to suppress that urge and force myself to verify what is actually happening rather than what I think is happening has been the most important part of my growth.
Its a continues process, you never stop learning.
Hi HN,Longtime lurker here.I built a tiny website called Latent Logbook. It's inspired by the spirit of Advent of Code, but focused on LLMs instead of algorithms.The idea is simple: You get a puzzle (like parsing a messy log file), you solve it using any model you like, and then you share your strategy. The goal isn't just to solve them but to see how different models handle them. It's...