Re:Show HN: Velvet – Store OpenAI requests in your own DB
by elawler24 on Tuesday September 24, 2024 @08:34PM
(#41642456)
Depends on the scenario. In a threaded query, or multiple queries from the same user - you’d want different outputs. If 20 different users are looking for the same result - a cache would return the right answer immediately for no marginal cost.
[ Parent
| on HN ]