Nice idea, thanks for publishing this, wondered for a long time why this wasn't yet in something like langchain (put it down to the storage aspect, despite query/query_with_sources being released recently). Having a cache system like this for the last 2 years we ran GPT-3 before the hype came has prevented us switching to langchain.