News for hackers. Stuff that matters.

touche_bag

Re:MongoDB Announces Acquisition of Voyage AI for $220M on Tuesday February 25, 2025 @06:12AM (#43170478)
100? I had a customer with 10k upserts incl merge logic for the upserts while serving 100k concurrent reads. Good luck doing that with a SQL database trying to check constraints across 10 tables. This is what Nosql databases are optimized for... There's some stand-out examples of companies scaling even mysql to ridiculous sizes. But generally speaking, relational databases don't do a great job at synchronous/transactional replication and scalability. That's the trade off you make for having schema checks and whatnot in place.
Re:MongoDB Announces Acquisition of Voyage AI for $220M on Tuesday February 25, 2025 @06:05AM (#43170435)
Huh? Rerank is always a boost on top of retrieval. So regardless of the chunking method or model you use, reranking with a good model will always result in higher MRR. And improvements in embedding models also will never solve the problem of merging lexical and vector search results. Rank/score fusion are flawed since both are hardly comparable and boosting only works sometimes. Whereas rerankers generally do a pretty good job at this. Performance is indeed the biggest issue here. Rerankers are slow as hell and simply not feasible for some use cases.
Re:MongoDB Announces Acquisition of Voyage AI for $220M on Tuesday February 25, 2025 @05:59AM (#43170377)
Consistent reads also mean additional checks. I think the WT cache is also very double edged. Completely cripples the database when resource constrained and not sized correctly, while giving a huge boost when the environment is "right sized". Honestly, give 8.0 and tell me how it compares. Haven't touched ancient Mongo versions in a long time, so I have little intuition on how it compares.
Re:MongoDB Announces Acquisition of Voyage AI for $220M on Monday February 24, 2025 @02:17PM (#43163672)
I think 8 was a release purely focused on performance, with some big improvements. Comparing 3.4 is kinda unfair.. You were fast with the tradeoff of half your data missing half the time
Re:MongoDB Announces Acquisition of Voyage AI for $220M on Monday February 24, 2025 @02:15PM (#43163646)
Interesting take. Have you benchmarked models on your own data? Cause at this point everything is contaminated so I find it impossible to tell what proper sota is. Also - most folks still just use openai. Last time I checked, reranking always performs better than pure vector search. And to my knowledge it's still the superior fusion method for keyword and vector results.