News for hackers. Stuff that matters.

A comment on Faiss: Facebook's open source vector search library. Parent comment

Re:Faiss: Facebook's open source vector search library by unbanned on Wednesday December 15, 2021 @01:23AM (#29562739)
Why 768? What are these dimensions
[ Parent | on HN ]
Re:Faiss: Facebook's open source vector search library by laingc on Wednesday December 15, 2021 @03:22AM (#29563307)
It comes from the dimensionality of the hidden state of popular NLP models. The number 768 in particular comes from (if I recall correctly) the largest of the original BERT models.
[ Parent | on HN ]
Re:Faiss: Facebook's open source vector search library by unbanned on Wednesday December 15, 2021 @06:55AM (#29564726)
So it's arbitrary then
[ Parent | on HN ]