Re:Show HN: Turning books into chatbots with GPT-3
by sdenton4 on Tuesday January 24, 2023 @08:58PM
(#34513415)
can i use the three dimensions to encode a space-filling curve over a 1000-dimensional embedding?
[ Parent
| on HN ]
Re:Show HN: Turning books into chatbots with GPT-3
by williamcotton on Wednesday January 25, 2023 @07:43AM
(#34517573)
Not precisely, but if you had 50 documents in that 1000-dimensional embedding and you reduced the dimensions to three and still got at least the exact same nearest neighbor ordering then it would at least still function, right?
I guess the problem is taking a new document (like a search term) in the higher dimensional embedding and reducing it to three dimensions for searching in that reduced space and expecting that to also maintain the same nearest neighbor ordering.