News for hackers. Stuff that matters.
Re:Kagi Small Web by sotix on Thursday September 07, 2023 @04:30PM (#37425127)
I would love to have my website added to the list because I block all crawlers in my robots.txt, but it looks like I’m not allowed to submit my own website. Is there a way to go about having it added? I would love to be part of kagi search results but don’t want to be scraped by Google, ChatGPT, or the next group, so I found it easiest to block everything.
Re:Kagi Small Web by judas44 on Friday September 08, 2023 @07:24AM (#37432153)
This is their own search index which is then enriched by licensed results in kagi: https://teclis.com/suggest.html