News for hackers. Stuff that matters.
Re:I want everything local – Building my offline AI workspace by iezepov on Saturday August 09, 2025 @12:26AM (#44844030)
Good point! Maybe indexing is a bad term here, and it's more like feature extraction (and since embeddings are high dimensional we extract a lot of features). From that point of view it makes sense that "the index" takes more space than the original data.
Re:I want everything local – Building my offline AI workspace by catlifeonmars on Saturday August 09, 2025 @01:06AM (#44844160)
Why would the embeddings be higher dimensionally than the data? I imagine the embeddings would contain relatively higher entropy (and thus lower redundancy) than many types of source data.
Re:I want everything local – Building my offline AI workspace by cm228 on Saturday August 09, 2025 @06:07AM (#44845319)
depends on the chunk-size used to create the embedding.