News for hackers. Stuff that matters.
Re:Ask HN: What technology do you use to collect data from a... by madhouse on Friday November 26, 2010 @03:15AM (#1941875)
This would vary from site to site, and if the HTML of one changes, the "collector" will need to be updated too.

It's a ton of work even for a few site, making it generic: yeah, you could do that, but then you'd have to provide unorganised data as a result, which wouldn't be useful at all.

Re:Ask HN: What technology do you use to collect data from a... by epynonymous on Friday November 26, 2010 @08:04PM (#1943935)
that's one of the problems that i considered since html is not that descriptive. i could also see sites purposely changing format just to cause incompatibility if they're not excited about you ripping data from them.

i feel that html should be slightly overhauled to add context to all data, so instead of a <td>, it's stock 52 week high or something along those lines.

i just had a thought, perhaps rss is the answer! do sites still use that? i kind of feel rss is a dead technology.