News for hackers. Stuff that matters.
Re:Introducing Twitter premium APIs by me_bx on Tuesday November 14, 2017 @02:58PM (#15698575)
A few years ago, the free search API could retrieve tweets since the beginning of twitter (although twitter did not guarantee completeness of the results): https://web.archive.org/web/20150311065138/https://dev.twitt...

Twitter then limited this API endpoint to data from the past seven days only, and now just introduces a paid version for only last 30 days data.

I find it fair to charge for elevated API access. On the other hand, the 30 days limit for the paid version is pretty ridiculous. Makes it more worth to just scrape the free online advanced search...

Re:Introducing Twitter premium APIs by andypiper on Tuesday November 14, 2017 @03:11PM (#15698685)
That's categorically not the case - the index for the search API has always been around 7 days since Twitter acquired Summize (which is where the search API came from). There was never an artificial limitation such as the one you're describing. From the page you're linking to from the archive:

"The Search API is not complete index of all Tweets, but instead an index of recent Tweets. At the moment that index includes between 6-9 days of Tweets."

Scraping the Twitter website is against the terms of service and may result in permanent suspension of access.

Re:Introducing Twitter premium APIs by gboudrias on Tuesday November 14, 2017 @05:19PM (#15699732)
> Scraping the Twitter website is against the terms of service and may result in permanent suspension of access.

Scraping is always against the ToS, so no surprise there. I doubt it's really ever stopped anyone.

Re:Introducing Twitter premium APIs by oculusthrift on Wednesday November 15, 2017 @02:54AM (#15702159)
i would imagine it stops researchers.. who usually try do things legit
Re:Introducing Twitter premium APIs by iagovar on Wednesday November 15, 2017 @12:18PM (#15705444)
It does. We contacted them seeking academic discounts, and there wasn't. I was in a little university in Spain. No one is going to drop 20k like that.
Re:Introducing Twitter premium APIs by me_bx on Tuesday November 14, 2017 @04:52PM (#15699522)
My bad, my memory failed me, I thought remembering being able to perform search on the historical tweets via the search endpoint.
Re:Introducing Twitter premium APIs by keiyakins on Tuesday November 14, 2017 @08:22PM (#15700814)
So is using it to incite violence. The Twitter tos isn't worth the paper it's written on.
Re:Introducing Twitter premium APIs by jalfresi on Wednesday November 15, 2017 @02:37AM (#15702085)
Scraping is how the web works. After all, retweets are essentially manual scrapes
Re:Introducing Twitter premium APIs by cisanti on Tuesday November 14, 2017 @05:36PM (#15699859)
> Scraping the Twitter website is against the terms of service and may result in permanent suspension of access.

And what is Twitter gonna do about it? I never sign the TOS and scrape as much as I want.

Re:Introducing Twitter premium APIs by iamthirsty on Tuesday November 14, 2017 @05:48PM (#15699970)
> may result in permanent suspension of access

A.k.a.: they will try their best to IP ban you.

Re:Introducing Twitter premium APIs by b4lancesh33t on Tuesday November 14, 2017 @06:23PM (#15700238)
And then if you circumvent that, perhaps bring charges under CFAA.
Re:Introducing Twitter premium APIs by manquer on Tuesday November 14, 2017 @09:46PM (#15701112)
Would work only if you are based in US thou
Re:Introducing Twitter premium APIs by xgbi on Wednesday November 15, 2017 @02:12AM (#15701999)
Yeah screw people accessing public information...
Re:Introducing Twitter premium APIs by iamthirsty on Wednesday November 15, 2017 @01:07PM (#15706046)
Well, that’s kinda the whole point. They don’t feel like it is truly public information. You gotta give something in return.
Re:Introducing Twitter premium APIs by williamscales on Friday November 17, 2017 @12:08AM (#15719102)
I wonder if this has changed in light of the recent LinkedIn decision?