justintorre75
Show HN: AI Trolley Problem Arena
https://www.aitrolleyproblem.com/
I built a tool that presents custom trolley problems to GPT, Claude, Gemini, Llama, Grok, and DeepSeek simultaneously and streams their ethical reasoning in real-time.Some interesting findings: - The models are surprisingly split on classic dilemmas. - Models will protect their creator (Sam Altman vs Dario Amodei) - Criminals are not valued equally even when compared to itselfTry it:...
Re:Show HN: Mcp-Agent – Build Effective Agents with Model Context Prot...
on Wednesday January 29, 2025 @08:40PM (#42873785)
MCP Agent seems super promising and the team behind it is amazing!
Show HN: Helicone (YC W23) – OSS LLM Observability and Development Platform
https://github.com/Helicone/helicone
Hey HN, we're Justin and Cole, the founders of Helicone (https://helicone.ai). Helicone is an open-source platform that helps teams build better LLM applications through a complete development lifecycle of logging, evaluation, experimentation, and release.You can try our free demo by signing up (https://helicone.ai/signup) or self-deploy with our new fully open-source helm chart...
LLM Stack Guide
Finetuned LLMs with 2 lines of code. Helicone + OpenPipe
Re:Finetuned LLMs with 2 lines of code. Helicone + OpenPipe
on Monday December 11, 2023 @09:58PM (#38608789)
A lot of people are asking how to automate their data flywheel. With Helicone + OpenPipe it has never been easier. With 2 lines of code, your app gets better over time without you needing to know how to finetune your own model.
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Friday March 24, 2023 @12:08AM (#35284976)
This is exactly right, thanks a bunch for checking. Also, thanks for the note! We will add a SECURITY.md
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Friday March 24, 2023 @12:04AM (#35284960)
Yeah this was added by accident, luckily we have pretty good management of local development and production testing, so these keys were not production keys
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @05:40PM (#35281678)
Thanks! Please reach out to the team on discord if you have any questions
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @05:10PM (#35281326)
Thanks! :D No need to bring your own logger, just change one line of code and then all your logs are in Helicone.
We are using CF Worker cache under the hood https://developers.cloudflare.com/workers/runtime-apis/cache...
We might use D1 for some of our other features like rate limiting.
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @05:08PM (#35281293)
Great question! The short answer is nothing! We just have to out pace them and make sure we develop a better product experience.
Two key advantages that we have over OpenAI. 1. We are open source and are trying to build a community of developers that can out run any single LLM provider. 2. We are completely provider agnostic, which allows us to aggregate and share common features across tools. (One analogy we like to use, is we want to emulate how dbt is database agonistic, and Helicone will grow to be provider agnostic)
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @04:49PM (#35281068)
Couldn't agree more. Thanks! :)
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @04:46PM (#35281039)
These are great! we looked into using reflare as well, however reflare does not support streaming at the moment. We are looking to give back to the community and add it for them.
I opened this issue up last week https://github.com/xiaoyang-sde/reflare/issues/443
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @04:45PM (#35281021)
stay tuned for updated pricing
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @04:40PM (#35280977)
This is so great! Thanks for the feedback. This is something we have thought a lot about, and really want to make sure we are adding the "correct" features that don't disrupt the user experience.
I kicked off a thread here https://github.com/Helicone/helicone/discussions/164 and would love your input!
P.S. that for the <title> note
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @04:01PM (#35280503)
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @03:33PM (#35280114)
We see a lot of applications on the market essentially "proxying" traffic to OpenAI, moving to a non-proxy implementation is not too hard if they have any issues with us doing this.
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @03:28PM (#35280062)
OpenAI is just the start to capture most of the market and iterate on some ideas first :). We are adding multiple providers soon. ~Stay tuned~
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI
on Thursday March 23, 2023 @03:27PM (#35280051)
Thanks! Glad Helicone was able to help your workflow.
Helicone.ai (YC W23) – Open-Source Logging for OpenAI
Hi HN - Justin, Scott, and Barak here. We're excited to introduce Helicone (https://www.helicone.ai) an open-source logging solution for OpenAi applications. Helicone's one-line integration logs the prompts, completions, latencies, and costs of your OpenAI requests. It currently works with GPT, and can be integrated with one line of code. There’s a demo at...