News for hackers. Stuff that matters.

thirdtrigger

MESHCode is a theory about how information might be stored in the brain. Very interesting and potentially has other implications for information storing as well. Check "The Mechanical Basis of Memory – the MeshCODE Theory": https://www.frontiersin.org/articles/10.3389/fnmol.2021.5929...
For Weaviate, you can check: https://weaviate.io/developers/weaviate/current/benchmarks/a... This is not a benchmark against other OSS solutions, but it gives you an understanding of what performance you can expect.

For production this might be helpful: https://weaviate.io/developers/weaviate/current/getting-star...

Re:The Full Power of Semantic Search and Vector Database on Wednesday August 03, 2022 @09:07AM (#32331187)
Great article! Thanks for sharing
Re:The AI-First Database Ecosystem on Friday June 24, 2022 @04:33PM (#31868941)
Thanks, that's actually helpful :)

Semantic Search Through Wikipedia

http://console.semi.technology/console/query#weaviate_uri=http://semantic-search-wikipedia-with-weaviate.api.vectors.network:8080&graphql_query=%23%23%0A%23%20This%20dataset%20contains%20the%20complete%20Wikipedia%20for%20semantic%20search%0A%23%0A%23%20info:%20https://weaviate.io/developers/weaviate/current/tutorials/semantic-search-through-wikipedia.html%0A%23%20vector%20search%20engine:%20https://weaviate.io%0A%23%20Github%20repo:%20https://github.com/semi-technologies/semantic-search-through-wikipedia-with-weaviate%0A%23%0A%23%20Docs:%20https://weaviate.io/developers/weaviate/current/%0A%23%20Semantic%20filters:%20https://weaviate.io/developers/weaviate/current/retriever-vectorizer-modules/text2vec-transformers.html%23neartext%0A%23%0A%23%23%0A{%0A%20%20Get%20{%0A%20%20%20%20Paragraph(%0A%20%20%20%20%20%20ask:%20{%0A%20%20%20%20%20%20%20%20question:%20%22Who%20was%20Stanley%20Kubrick?%22%0A%20%20%20%20%20%20%20%20properties:%20[%22content%22]%0A%20%20%20%20%20%20}%0A%20%20%20%20%20%20limit:%201%0A%20%20%20%20)%20{%0A%20%20%20%20%20%20content%0A%20%20%20%20%20%20order%0A%20%20%20%20%20%20title%0A%20%20%20%20%20%20inArticle%20{%0A%20%20%20%20%20%20%20%20...%20on%20Article%20{%0A%20%20%20%20%20%20%20%20%20%20title%0A%20%20%20%20%20%20%20%20}%0A%20%20%20%20%20%20}%0A%20%20%20%20%20%20_additional%20{%0A%20%20%20%20%20%20%20%20answer%20{%0A%20%20%20%20%20%20%20%20%20%20result%0A%20%20%20%20%20%20%20%20}%0A%20%20%20%20%20%20}%0A%20%20%20%20}%0A%20%20}%0A}

( Read More... | no comments | 2 points | on HN )
Re:Vector search engine ANN benchmarks on Tuesday May 24, 2022 @09:17AM (#31491651)
There is also a podcast where the results are discussed: https://youtu.be/kG3ji89AFyQ
Re:Ask HN: Who wants to collaborate? (April 2022) on Saturday April 02, 2022 @04:38PM (#30891473)
Agreed! You can check out Weaviate too. It includes out of the box vectorization modules
Re:Home Depot Finds DIY Success with Vector Search on Wednesday March 16, 2022 @03:13PM (#30702762)
Super cool article, we work on OSS vector search technology (Weaviate) as well and I can confirm that we see many similar use cases especially with multi-model models and rerankers.
Re:Text2vec-Openai Module in Weaviate on Thursday January 27, 2022 @02:44PM (#30105339)
Thanks and couldn't agree more! Its great to see how these models work in harmony with a vector search engine like Weaviate.
Re:Find anything fast with Google's vector search technology on Wednesday December 15, 2021 @12:56AM (#29562595)
Did you see this blog? https://db-engines.com/en/blog_post/87

It's an interesting point tho. Maybe it's good to add this to the docs as well

Re:Find anything fast with Google's vector search technology on Wednesday December 15, 2021 @12:53AM (#29562580)
> I am still waiting to see an end to end API doing all this

That’s kinda the idea of Weaviate. You might like the Wikipedia demo dataset that contains all this. You indeed need to run this demo on your own infra but the whole setup (from vector DB to ML models) is containerized https://github.com/semi-technologies/semantic-search-through...

Re:Find anything fast with Google's vector search technology on Tuesday December 14, 2021 @05:36PM (#29559079)
Not true – Weaviate is open source: https://github.com/semi-technologies/weaviate
Re:Find anything fast with Google's vector search technology on Tuesday December 14, 2021 @05:04PM (#29558647)
We are actually discussing this on the Weaviate Slack :-) https://weaviate.slack.com/archives/D02JM9D3HND/p16347312830...
Re:Find anything fast with Google's vector search technology on Tuesday December 14, 2021 @05:02PM (#29558614)
That's a fair question – but I'm going to assume the open-source nature is being meant with this.
Re:Find anything fast with Google's vector search technology on Tuesday December 14, 2021 @04:04PM (#29557722)
Jup – this is an example from the demo dataset in the docs: https://link.semi.technology/3DPcphe
Re:Find anything fast with Google's vector search technology on Tuesday December 14, 2021 @03:21PM (#29557005)
These are all great!

There is also this video about modern search engines and Weaviate on the AI Coffee Break YT channel: https://www.youtube.com/watch?v=YkK5IKgxp-c

Re:Find anything fast with Google's vector search technology on Tuesday December 14, 2021 @02:50PM (#29556554)
Interesting – we are working on an open source vector search engine called Weaviate and did the same for the complete Wikipedia and Wikidata.

[1] Docs: https://www.semi.technology/developers/weaviate/current/

[2] Github: https://github.com/semi-technologies/weaviate

[3] Wikipedia demo dataset: https://github.com/semi-technologies/semantic-search-through...

[4] Wikidata dataset: https://github.com/semi-technologies/biggraph-wikidata-searc...

Last week there was also a feature on Techcrunch about vector search and Weaviate: https://techcrunch.com/2021/12/11/2246180/

Older »