Re:Build Personal ChatGPT Using Your Data
by avereveard on Sunday July 09, 2023 @01:40AM
(#36651885)
Setting up an embedding alternative out of huggingface sentence transformers is fairly easy, the magical thing openai does is that they will create embedding of 8192 characters at a time while most other emerging will force you to chunk your documents in 512 characters long sequences, losing lot of context, multiplying your queries result, search times etc
[ Parent
| on HN ]
There are no comments on this comment yet.