Re:My 15 Years Striving for Search Engine Independence. AMA
by mojeek on Friday March 19, 2021 @04:57AM
(#26511271)
https://www.etools.ch/ is one.
We originally seeded it with URLs from DMOZ. Now we have our own page weight that in combination with modified dates decides what is crawled and when.
> We have provided our results to multiple metasearch engines over the years and currently provide them to a number of people for various uses.
Are you able to name any?
Also: what (if any) are some "starting points" for your crawl? I know that Right Dao uses Wikipedia dumps as one of its sources, for instance.