News for hackers. Stuff that matters.
Re:Mixnode: Turn the web into a database by Ayesh on Monday October 08, 2018 @05:08AM (#18165596)
This. I write crawler software (adapters mostly) for the same client, and I could never figure out anneasy way for my client to specify the xpath/case paths in a meaningful way and extract the data.

Every crawler task requires different paging methods, different xpath patterns, etc that it makes things more complicated to generalize it.

There are no comments on this comment yet.