News for hackers. Stuff that matters.
Re:Structured Output from LLMs (Without Reprompting!) by swyx on Sunday July 16, 2023 @08:47PM (#36752890)
100s of RPS? did you have a successful launch elsewhere or something? bc this repo currently only has 21 stars, which taking normal correlation into account does not imply that level of traffic
Re:Structured Output from LLMs (Without Reprompting!) by sandkoan on Sunday July 16, 2023 @09:24PM (#36753073)
We have folks playing around with it mostly through the playground / raw HTTP endpoints as opposed to the Python API. And we've got some batch jobs running, which adds further traffic.