News for hackers. Stuff that matters.
Re:Build Personal ChatGPT Using Your Data by avereveard on Sunday July 09, 2023 @01:40AM (#36651885)
Setting up an embedding alternative out of huggingface sentence transformers is fairly easy, the magical thing openai does is that they will create embedding of 8192 characters at a time while most other emerging will force you to chunk your documents in 512 characters long sequences, losing lot of context, multiplying your queries result, search times etc

There are no comments on this comment yet.