News for hackers. Stuff that matters.
Re:Launch HN: Openlayer (YC S21) – Testing and Evaluation fo... by rishramanathan on Tuesday December 05, 2023 @11:58AM (#38533491)
We’ve actually been building a testing and evaluation platform from the start, but started with discriminative ML tasks like classification and regression. We waited to do a Launch HN because we were mostly focused on enterprise / mid-market.

These past few months, however, we’ve prioritized building out features for testing and monitoring LLMs.

LLMs certainly have their unique challenges, but the evaluation problem in general is not new, and much of what we’ve built historically is very much applicable to this new crop of ML use cases!

There are no comments on this comment yet.