News for hackers. Stuff that matters.
Re:Hypothetical Indexes in PostgreSQL by fake-name on Tuesday July 02, 2019 @04:01PM (#20338897)
I wrote a custom SP-GiST index for fuzzy image searching. Along the way, I also wound up with a decent example in how to do a simple binary-tree SP-GiST index.

SP-GiST indexes are specific to optimizing data that can fit into a metric-space, but if your application can use that, it's on github here: https://github.com/fake-name/pg-spgist_hamming

Re:Hypothetical Indexes in PostgreSQL by tsomctl on Tuesday July 02, 2019 @04:21PM (#20339069)
Hey, fake-name, I've been following your work. Have you looked into faiss from Facebook or annoy from Spotify? Their biggest drawback is that you can't modify the index, you have to create a new one if you want to add additional entries.
Re:Hypothetical Indexes in PostgreSQL by fake-name on Tuesday July 02, 2019 @06:49PM (#20340093)
> Their biggest drawback is that you can't modify the index

I hadn't looked into them, but being read only would make them useless for my use case.

Basically, my application is online zips-of-images set deduplication, with a continuous input stream of files. I have to be able to add new values continuously.

Re:Hypothetical Indexes in PostgreSQL by bobosha on Wednesday July 03, 2019 @06:21AM (#20343059)
related: we just opensourced pgANN[1] that allows ANN searches and include an example for image search. It uses the vectors from an imagenet and find it works well for our needs.

[1] https://github.com/netrasys/pgANN/blob/master/README.md