Re:Web Scraping in Python – The Complete Guide
by ravenstine on Tuesday February 20, 2024 @05:40PM
(#39447942)
Although it works most of the time, I've found it's common for it to either pick up things that shouldn't be included or it only picks up something like the footer but not the actual body. This can be true even when, upon inspection, there's no clear reason why the body couldn't be identified. It's particularly problematic on many academic articles that are in HTML (sort of ironic). I'd also like a bit more normalization built in, even if it's turned off by default.
[ Parent
| on HN ]
There are no comments on this comment yet.