>Spotted this idea from Hassan Hayat: “don’t embed the question when searching. Ask GPT-3 to generate a fake answer, embed this answer, and use this to search”. See also this paper about Hypothetical Document Embeddings, via Jay Hack.

That is incredibly interesting. We really need an Internet-scale semantic search engine API to try out this and make interesting LLM-based tools. Hooking up LLMs to classic keyword search engines like Bing and Google often gives underwhelming results.