Re:Colly: Fast and Elegant Scraping Framework for Golang
by bryanrasmussen on Thursday October 05, 2017 @11:37AM
(#15410014)
yes, this would be capable of waiting, but it doesn't have the abstraction built in so it looks like it would have the same problem I often run into with scapers - you go through page to get links to follow/markup to act on and then have to wait a reasonable amount of time / catch some browser based event to determine if you need to look at content one more time before continuing.
[ Parent
| on HN ]
There are no comments on this comment yet.