News for hackers. Stuff that matters.
Re:Facebook was used as a proxy by web scraping bots by mtberatwork on Friday November 06, 2020 @07:13AM (#25007058)
Doesn't the oembed spec [1] already solve this? I think the OP could solve their problem by simply creating an oembed endpoint with all the necessary meta data.

[1] https://oembed.com/

Re:Facebook was used as a proxy by web scraping bots by 67868018 on Friday November 06, 2020 @09:45PM (#25012889)
Yea but when your request to fetch the oembed data is blocked by a CAPTCHA...

This is a real problem, we experience it in the Fediverse