News for hackers. Stuff that matters.
Re:Reconstructing Twitter's Firehose by nspkr on Wednesday February 27, 2019 @05:29PM (#19267522)
>Twitter’s statuses lookup API endpoint allows for a total of 1,200 API calls every 15 minutes. Each call allows the user to pass 100 ids for a total of 120,000 id requests every 15 minutes using both APP auth [...]

Use the secret consumer keys from Twitter to bypass these limits: https://gist.github.com/shobotch/5160017

Re:Reconstructing Twitter's Firehose by throwawaymath on Wednesday February 27, 2019 @06:38PM (#19267912)
I can't imagine these will last long now that they've been posted in a comment on a front page HN story.
Re:Reconstructing Twitter's Firehose by gberger on Wednesday February 27, 2019 @06:47PM (#19267951)
These are hardcoded in the apps. If they disable a key, they would need to release a new version of the app (ok), and all users would need to update (infeasible).
Re:Reconstructing Twitter's Firehose by mrits on Wednesday February 27, 2019 @11:40PM (#19268991)
Wouldn't they just enforce the limit with those keys as well?
Re:Reconstructing Twitter's Firehose by Nextgrid on Thursday February 28, 2019 @09:03AM (#19271348)
They explicitly want to cripple third-party apps to push users to use their (awful) official clients, and their way of doing so is to enforce unreasonably low limits.

If they were to do the same with their official clients they'd become unusable.

Re:Reconstructing Twitter's Firehose by metildaa on Thursday February 28, 2019 @02:09AM (#19269575)
Sounds like a solid reason to not build around a platform that can arbitrarily kill your project or business. ActivityPub seems to be gaining traction, w/o the beholden to a single entity issue.
Re:Reconstructing Twitter's Firehose by jjeaff on Thursday February 28, 2019 @04:07AM (#19270053)
A platform that can arbitrarily take down your business like a mobile app on iPhone or Android?
Re:Reconstructing Twitter's Firehose by ihuman on Wednesday February 27, 2019 @06:50PM (#19267959)
The Twitter for Android key and secret is at least 8 years old

https://twitter.com/kevinriggle/status/23932444186

Re:Reconstructing Twitter's Firehose by nspkr on Wednesday February 27, 2019 @07:09PM (#19268030)
I've been using them for years now.
Re:Reconstructing Twitter's Firehose by Thaxll on Wednesday February 27, 2019 @10:45PM (#19268832)
You can do the same for the Reddit API, change the agent header and then you have unlimited API calls.
Re:Reconstructing Twitter's Firehose by ihuman on Thursday February 28, 2019 @09:52AM (#19271639)
Just be careful about how much you change it, since you could get banned. You might be able to get away with changing the app ID or version, but even that's risky.

> NEVER lie about your user-agent. This includes spoofing popular browsers and spoofing other bots. We will ban liars with extreme prejudice.

https://github.com/reddit-archive/reddit/wiki/API

Re:Reconstructing Twitter's Firehose by thinkloop on Thursday February 28, 2019 @02:10AM (#19269579)
How would that work, I couldn't find much on the web?
Re:Reconstructing Twitter's Firehose by Thaxll on Thursday February 28, 2019 @07:56AM (#19270998)
Same problem as the mobile app for Twitter, they can't block people that are not logged in the mobile app so they don't rate limit them.
Re:Reconstructing Twitter's Firehose by thinkloop on Thursday February 28, 2019 @09:57PM (#19277590)
How come they can block people on the web again?
Re:Reconstructing Twitter's Firehose by dewey on Thursday February 28, 2019 @02:41AM (#19269697)
Probably by doing a mitm attack on the mobile app and using the headers used there.
Re:Reconstructing Twitter's Firehose by thsowers on Wednesday February 27, 2019 @07:34PM (#19268142)
Seems like a good way to get your IP blacklisted
Re:Reconstructing Twitter's Firehose by mhfs on Wednesday February 27, 2019 @08:16PM (#19268293)
I worked with a company in the past that abused the twitter api to an unimaginable level from a single IP address.

That was a few years ago but at the time I’m pretty sure their blacklisting was between inexistent and pathetic.

Re:Reconstructing Twitter's Firehose by dev_dull on Wednesday February 27, 2019 @10:20PM (#19268755)
It’s sad that you think this somehow reflects badly on Twitter. I appreciate a company that will opt to be conservative rather than ban-hammer innocent people on accident just to stop a single idiot.
Re:Reconstructing Twitter's Firehose by mhfs on Wednesday February 27, 2019 @10:40PM (#19268816)
I don’t think it reflects badly on Twitter, it was simply a remark on the state of their blacklisting at the time. I’m sure they could’ve done a lot better if they chose to. Sorry I didn’t expressed myself better.
Re:Reconstructing Twitter's Firehose by jorvi on Thursday February 28, 2019 @01:17AM (#19269348)
> It’s sad that you think this somehow reflects badly on Twitter. I appreciate a company that will opt to be conservative rather than ban-hammer innocent people on accident just to stop a single idiot.

Off-topic but reminds me of ~2004 where we had a particularly pervasive cheater in our dedicated game server and the end decision of the admin was to just ban the entire IP range of said cheaters' ISP. Not particularly conservative - very effective.

Re:Reconstructing Twitter's Firehose by tomglynch on Wednesday February 27, 2019 @08:32PM (#19268338)
Using these keys?
Re:Reconstructing Twitter's Firehose by mhfs on Wednesday February 27, 2019 @08:39PM (#19268369)
No. Different strategy.
Re:Reconstructing Twitter's Firehose by adrianN on Thursday February 28, 2019 @05:07AM (#19270276)
Seems like a good way to get an angry e-mail from your ISP, or Twitter's lawyer.
[dead]
Re:Reconstructing Twitter's Firehose by unityByFreedom on Thursday February 28, 2019 @12:52AM (#19269242)
Hackernews..
Re:Reconstructing Twitter's Firehose by miki123211 on Thursday February 28, 2019 @03:01AM (#19269793)
Can we use them to get the streaming API back? I think the apps still use something like that.