News for hackers. Stuff that matters.
Re:March 20 ChatGPT outage: Here’s what happened by dpkirchner on Friday March 24, 2023 @02:03PM (#35293136)
Of course? I'm not really sure what the original question actually is if you know that users benefit from caching the results of computationally intensive queries.
Re:March 20 ChatGPT outage: Here’s what happened by killerstorm on Friday March 24, 2023 @02:14PM (#35293303)
OpenAI uses redis to store pieces of text. Fetching pieces of text is not computationally intensive.
Re:March 20 ChatGPT outage: Here’s what happened by mannyv on Friday March 24, 2023 @04:35PM (#35295065)
Most likely they have them in an rdbms, so it's more like joining a forum thread together. Not expensive, but why not prebuild and store it instead?