News for hackers. Stuff that matters.
Re:Tweetbot Is Broken by black_puppydog on Friday January 13, 2023 @05:15AM (#34365919)
you get into an armsrace where twitter will obfuscate the markup to just wear out the scraper devs. which they can, because $$$
Re:Tweetbot Is Broken by mrtksn on Friday January 13, 2023 @05:16AM (#34365927)
Then just OCR the rendered output. It's cheap and easy these days.
Re:Tweetbot Is Broken by mlatu on Friday January 13, 2023 @05:34AM (#34366037)
i heard it works best on iphones, best of luck
Re:Tweetbot Is Broken by mrtksn on Friday January 13, 2023 @05:40AM (#34366083)
Apple’s vision framework is actually very good, so effective on-device extraction is really just a few lines of code on iPhone(all Apple device actually).
Re:Tweetbot Is Broken by tsimionescu on Friday January 13, 2023 @06:57AM (#34366611)
Good lick OCR-ing images and videos, though. Twitter isn't just text.
Re:Tweetbot Is Broken by mrtksn on Friday January 13, 2023 @07:12AM (#34366722)
Why do I need to OCR images and videos? Why not display those as-is?
Re:Tweetbot Is Broken by tsimionescu on Friday January 13, 2023 @08:17AM (#34367248)
Which one do you show for which tweet, if all you have is the OCR (that is, you can't read the markup)?
Re:Tweetbot Is Broken by mrtksn on Friday January 13, 2023 @08:30AM (#34367368)
Apple's vision framework is not limited to text, can detect shapes and other things.

Twitter WebUI loads images and videos when you scroll. Which means you have a good signal what image and video is associated with what tweet.

Re:Tweetbot Is Broken by actualwitch on Friday January 13, 2023 @06:21AM (#34366353)
Doing this requires a fair amount of development time, especially when you can break something else with this and you previously removed all the guardrails.
Re:Tweetbot Is Broken by Mindwipe on Friday January 13, 2023 @06:51AM (#34366567)
That didn't stop Facebook doing it (and breaking all kinds of stuff in the process).
Re:Tweetbot Is Broken by Hamuko on Friday January 13, 2023 @07:11AM (#34366711)
Did Facebook lay off half of the company before they did it?
Re:Tweetbot Is Broken by raydev on Friday January 13, 2023 @01:03PM (#34371444)
Facebook had far more engineers available to do this sort of work.
Re:Tweetbot Is Broken by nkozyra on Friday January 13, 2023 @07:12AM (#34366718)
They don't do this when they can just disable the app without being logged in.