News for hackers. Stuff that matters.
Re:Ask HN: What info do you web scrape for? by jasallen on Monday August 11, 2014 @02:08PM (#8164404)
I am currently scraping for brand product and nutrition data. Having to build custom scrapers per brand is hell.

I have a dream to use something closer to OCR against a rendered page, rather than parsing DOM. That way it would be less custom, and I could say, for instance, "find 'protein', the thing to the right of that is the protein grams".

I, personally, don't know how to do this, but I'd be willing to pay for a more generic way to scrape nutrition data (email in profile :) )

Re:Ask HN: What info do you web scrape for? by imns on Friday August 15, 2014 @10:07AM (#8182179)
There's companies out there that already have this info. Checkout http://kwikeesystems.com .
Re:Ask HN: What info do you web scrape for? by carucez on Tuesday August 12, 2014 @10:01PM (#8171123)
take a block of text, sentence, or paragraph.

build 2 classifiers: #1 that classifies a sentence that contains the information you want, and #2 that classifies the actual data within that subset.

NLP