News for hackers. Stuff that matters.

marcusae313

Re:Vector Databases: Feature or Product? on Tuesday February 25, 2025 @01:24PM (#43175472)
This is the same conversation we have when we add any specialized data store. Shortly after MongoDB, Cassandra, Couchbase, Elasticsearch, and Solr, critics asked couldn’t we just contort RDBMS to handle documents for flexible queries or searches. The history tells a different story. The scaling properties and feature expectations of the specialized stores culminating in tens of billions of market cap, and much more in terms of infrastructure spend.

Could the incumbents simply tack on vector features? Sure, that’s the JSONB story of Postgres. It’s the regex story of all RDBMS offerings after Oracle’s acquisition of Endeca suggested a real commercial opportunity for search-specific databases.

Vector-first storage engines have a place in the market as much as the tack on solutions do. PGVector will be good enough for most users, and Weaviate (or Milvus) will be better suited for the most ambitious, or those seeking the best dev ex.

What’s the best reason to use this tool?
Re:Hacker Stole Secrets from OpenAI on Friday July 05, 2024 @07:42PM (#40887048)
At first glance, this security incident looks like a non-issue for the most part. It's common that companies' customer forums or support portals are compromised. It seems like a common attack vector. While, I'm relatively certain some very nasty breaches will come with time and the proliferation of vendors, has there already been a catastrophic security incident that happened as a result of using proprietary, closed-source LLMs?
Twitter still uses Lucene. They built a custom codec for it, but doesn't change the cost too much.
The tech world should smash buy now and contribute in every way they can to improve the technology.

Most technology companies should hold it on their balance sheets and employ a contributor.

I should rephrase. Just buy. If you want to get involved and contribute, please do. Money in the hands of centralized figures is very dangerous.
When I first explained bitcoin to my mom and her friends, they didn't get it.

The second time, I explained it, they didn't get it. The third time, I sat them down, and made them learn how to run full nodes, run a few commands on the command line, and use bitcoin. Western Union is certainly not guaranteed, nor tyranny proof. If the governments of Argentina or Pakistan need the USD bad enough, they will every dollar Western Union is holding for recipients. To keep the story quiet and the money flowing in, they may imprison the recipients and their families. Desperate times call for desperate measures.

No it did not, but art did and still does. A lot of art in the future will have a non-fungible identity on chain. It's starting and will only grow rapidly.
It's all a significant risk to the internet.
For the other folks in the room, Atlas Search allows you to eliminate the sort code here, introduce autocomplete, and speeds up performance dramatically. Available on the free tier. You can read about it here: https://docs.atlas.mongodb.com/atlas-search/
Re:Challenges in Implementing a Full-Text-Search Engine on Saturday September 21, 2019 @07:14PM (#21038497)
I agree with you for the most part. There are companies providing an extensible and open source platform for incorporating models into production systems and even helping you build those models, like Lucidworks (my employer). Algolia platform is not powered by any ML afaik because their system is very closed and not easily tuned.
Re:Ask HN: Are Lucene/Solr/ES Still Used for Search? on Friday July 19, 2019 @03:25PM (#20481695)
SOLR for the full-text win.
Re:Ask HN: Are Lucene/Solr/ES Still Used for Search? on Friday July 19, 2019 @03:08PM (#20481567)
Using SOLR heavily. I have a strong preference for SOLR when it comes to Full Text and ELK when it comes to logs.
Re:The Internet of Compromised Things on Saturday August 08, 2015 @02:17PM (#10028161)
VPN addresses a different issue not the one discussed in the article. If your router is compromised, then the encryption on the local network is useless, including that which is used to encrypt the VPN tunnel.
Re:Show HN: Kaiwa, a Modern Open-Source XMPP Web Client on Wednesday April 08, 2015 @01:22PM (#9342351)
very exciting.

need to try it out to see how extensible it is.