Re:Mojeek Surpasses 5B Pages
by moralestapia on Tuesday March 15, 2022 @12:37PM
(#30687439)
Thanks for being here Colin, that says a lot about your commitment to the product :)
I will take a look at your API as I'm currently doing my own thing using Common Crawl + some perl (yeah... perl) scripts, but that's quite expensive to maintain.
Re:Mojeek Surpasses 5B Pages
by vivekraghunatha on Tuesday March 15, 2022 @11:57AM
(#30686914)
(Founder of Neeva here) Colin -- huge congratulations on the 5B milestone. Crawling the web, building and serving a large index, and powering your own ranking is not for the faint of heart. Great job!
No impact of UK laws, at least yet. That might change for us and every other search engine/service with UK users, but recent indications are encouraging on search, if not social media [1]. Our take on anonymity here [2].
[0] https://blog.mojeek.com/2021/07/time-to-ban-surveillance-bas...
[1] https://blog.mojeek.com/2021/08/online-safety-our-feedback-t...
[2] https://blog.mojeek.com/2021/10/in-defence-of-online-anonymi...