Re:Tweetbot Is Broken
by black_puppydog on Friday January 13, 2023 @05:15AM
(#34365919)
you get into an armsrace where twitter will obfuscate the markup to just wear out the scraper devs. which they can, because $$$
[ Parent
| on HN ]
Then just OCR the rendered output. It's cheap and easy these days.
i heard it works best on iphones, best of luck
Apple’s vision framework is actually very good, so effective on-device extraction is really just a few lines of code on iPhone(all Apple device actually).
Re:Tweetbot Is Broken
by tsimionescu on Friday January 13, 2023 @06:57AM
(#34366611)
Good lick OCR-ing images and videos, though. Twitter isn't just text.
Why do I need to OCR images and videos? Why not display those as-is?
Re:Tweetbot Is Broken
by tsimionescu on Friday January 13, 2023 @08:17AM
(#34367248)
Which one do you show for which tweet, if all you have is the OCR (that is, you can't read the markup)?
Apple's vision framework is not limited to text, can detect shapes and other things.
Twitter WebUI loads images and videos when you scroll. Which means you have a good signal what image and video is associated with what tweet.
Re:Tweetbot Is Broken
by actualwitch on Friday January 13, 2023 @06:21AM
(#34366353)
Doing this requires a fair amount of development time, especially when you can break something else with this and you previously removed all the guardrails.
That didn't stop Facebook doing it (and breaking all kinds of stuff in the process).
Did Facebook lay off half of the company before they did it?
Facebook had far more engineers available to do this sort of work.