News for hackers. Stuff that matters.
Re:Cross-Lingual News Dedup at $100/Month – Embeddings, Pgve... by ethan_zhao on Wednesday March 04, 2026 @06:02AM (#47245838)
Author here. I built this for 3mins.news, an AI news aggregator covering 180+ sources in 17 languages. The trickiest part was figuring out that articles in different languages about the same event share zero tokens — MinHash/LSH gives you Jaccard similarity of 0.

Happy to answer questions about the pgvector setup, Cloudflare Workers constraints, or the clustering algorithm tuning.

There are no comments on this comment yet.