News for hackers. Stuff that matters.
Re:Show HN: Voyager – write a web crawler/scraper as a state... by michael_j_ward on Wednesday December 30, 2020 @04:17PM (#25586228)
I assume the website has something like "requests per second" quota, which then you'd want the `governor` crate [0].

It was recently used to implement rate limiting middleware for both tide[1] and actix[2]

[0] https://docs.rs/governor/0.3.1/governor/_guide/index.html

[1] https://github.com/ohmree/tide-governor

[2] https://github.com/AaronErhardt/actix-governor

There are no comments on this comment yet.