News for hackers. Stuff that matters.
Re:Show HN: Velvet – Store OpenAI requests in your own DB by elawler24 on Tuesday September 24, 2024 @08:34PM (#41642456)
Depends on the scenario. In a threaded query, or multiple queries from the same user - you’d want different outputs. If 20 different users are looking for the same result - a cache would return the right answer immediately for no marginal cost.
Re:Show HN: Velvet – Store OpenAI requests in your own DB by OutOfHere on Tuesday September 24, 2024 @08:56PM (#41642569)
That's not the use case of the parent comment:

> for queries that are sufficiently similar