News for hackers. Stuff that matters.

A comment on Helicone.ai (YC W23) – Open-Source Logging for OpenAI.

Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by StablePunFusion on Thursday March 23, 2023 @03:21PM (#35279980)
The entire company is based around the idea of providing metrics for one closed-source platform's API? Or is the "OpenAI application observability" just one part of what the company does? Otherwise it seems like taking the "all eggs in one basket" to the extreme.
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by version_five on Thursday March 23, 2023 @03:29PM (#35280070)
To be fair, there are companies based on providing metrics for AWS, e.g. Vantage, so it's not surprising to see VCs making bets in this area
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by VWWHFSfQ on Thursday March 23, 2023 @03:37PM (#35280164)
AWS provides services and APIs to support that specific usage. This service is MITM'ing another company's API. I'm pretty sure AWS wouldn't tolerate that sort of thing.
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by version_five on Thursday March 23, 2023 @03:53PM (#35280404)
One could think about it as consulting, but productized, on top of a service. Something like AWS is mind numbingly complicated. Amazon has solutions engineers but there's also a big 3rd party market. And some part of that market doesn't need fully bespoke solutions but can be well served by a SaaS that sits on top (of course entailing risk, but it's all risky).

OpenAI isn't there yet, personally I'm bearish on generative AI and openAIs dominance, but they're the major player, and there's a version of the future where they dominate the landscape with a complex enterprise offering like AWS that leaves room for intermediaries. So it's not a bad idea to include bets on people who are building these intermediary products as part of a vc portfolio.

[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by aryamaan on Thursday March 23, 2023 @10:54PM (#35284474)
(my understanding might in incorrect but) is it not how cloudflare prevents DDOS attack?
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by 0xDEF on Thursday March 23, 2023 @03:49PM (#35280341)
AWS is a whole other beast than the few dozen REST and SSE endpoints at OpenAI.
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by justintorre75 on Thursday March 23, 2023 @03:28PM (#35280062)
OpenAI is just the start to capture most of the market and iterate on some ideas first :). We are adding multiple providers soon. ~Stay tuned~
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by meghan_rain on Thursday March 23, 2023 @03:49PM (#35280336)
What providers apart from OpenAI exist?
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by gmaster1440 on Thursday March 23, 2023 @03:32PM (#35280100)
It's a big basket.
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by snacktaster on Thursday March 23, 2023 @03:28PM (#35280053)
It seems pretty brittle to me also. And their solution is to actually _proxy_ OAI's API wholesale which doesn't seem like a very good idea and might not even be permitted.
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by quadcore on Thursday March 23, 2023 @04:06PM (#35280556)
"all eggs in one basket" to the extreme.

You couldn't describe better what a startup must do.

[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by throwaway280382 on Thursday March 23, 2023 @04:06PM (#35280561)
I guess they are betting that openAI will be such a big platform that many companies will need this capability. Not a bad idea I guess
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by gregschlom on Thursday March 23, 2023 @04:22PM (#35280782)
"Solve one pain point for OpenAI's users, get some nice traction, get acquired by OpenAI in a couple of months" is probably the plan here. Not a bad one to turn a quick profit.
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by jacquesm on Thursday March 23, 2023 @11:29PM (#35284742)
Do you think OpenAI is not logging their users' interactions already?
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by CGamesPlay on Friday March 24, 2023 @12:04PM (#35291026)
They certainly aren't exposing those logs back to the customer. There doesn't seem to be a way to see anything other than "total cost per day" in the dashboard. I like that Helicone allows me to see each request and export them all, so that I can use that to build my fine-tuning dataset.
[ Parent | on HN ]
Re:Helicone.ai (YC W23) – Open-Source Logging for OpenAI by jacquesm on Friday March 24, 2023 @01:02PM (#35292066)
True, but why would they acquire a company for something they already have: the users and the logs. The tech is trivial.
[ Parent | on HN ]