Re:The Software Engineering Rule of 3
by ptr on Wednesday August 30, 2017 @09:14AM
(#15131829)
Why not just pull it out into a function, "loginWithForm(session, 'user', 'password')"? Why is it interesting on a class level that the scraper is using a form based authentication method? What if a page is switching between two authentication methods just for laughs?
[ Parent
| on HN ]
Re:The Software Engineering Rule of 3
by razorunreal on Wednesday August 30, 2017 @09:19AM
(#15131879)
I think you've hit it on the head. Mostly you shouldn't be trying to codify what a scraper is, you should be collecting little utilities that are useful for building scrapers. The more lego-like the better.