Re:WrapAPI v2: build APIs, bots, and scrapers on websites; f...
by divad12 on Tuesday April 18, 2017 @01:19PM
(#14140755)
This seems like it could be really useful. How do you deal with sites that might block you?
Re:WrapAPI v2: build APIs, bots, and scrapers on websites; f...
by phsource on Tuesday April 18, 2017 @01:23PM
(#14140794)
We currently don't deal with it, but when using WrapAPI, you can specify your own proxy servers and we'll route the requests through them.
This was yet another of the features that we added only after getting feedback last time around from HN, so good catch!
In short, we've:
1) Improved the Chrome extension to guess what parts of your requests are important.
2) Made a new browser-like "builder" that should be much more intuitive to use compared to the old system.
Let us know what you think!