Re:Nitter: Alternative Twitter Front-End
by littlestymaar on Wednesday August 25, 2021 @03:51AM
(#28299041)
Wow!
But there must be some kind of IP based rate limiting or something, right? At least for DDoS protection even if it's not intended to prevent scrapping.
To see the gt, read the contents of twitter.com
For example, using Chrome
or curl To retrieve tweets three steps are required: 1. retrieve the "guest token" (gt), 2. retrieve the "REST ID" (rest_id) for the twitter.com user and 3. submit a GraphQL query to retrieve the user's tweets.Javascript provided by Twitter in the twitter.com can do these three steps automatically (but this requires using a Javascript-enabled browser), or it can be done without a browser, e.g., with a different scripting language (personally I use the shell).
For example, some folks use Python:
https://pypi.org/project/twint/