News for hackers. Stuff that matters.
Re:Show HN: Artemis, a Calm Web Reader by marginalia_nu on Friday December 20, 2024 @01:09PM (#42473308)
I've been doing adjacent work for my search engine[1], and found substack to annoyingly be one of the sites that employ bot mitigation for its RSS endpoints. If you fetch at a very low rate it works fine, but for these types of bulk retrieval.

Substack is also a bit of a pain to integrate with because they have zero useful contact information and direct all inquiries to a chatbot that is beyond useless, makes it so you have to guess how they want you to interact with their servers since there is nobody to answer questions.

[1] Preview of my take of the idea: https://mastodon.social/@marginalia/113670235590972416

There are no comments on this comment yet.