News for hackers. Stuff that matters.
Re:Tweetping, Twitter traffic in real time by tibbon on Tuesday January 29, 2013 @07:34PM (#5137361)
How are they getting the data? Twitter's APIs seem so limited these days.
Re:Tweetping, Twitter traffic in real time by FranckErnewein on Tuesday January 29, 2013 @07:54PM (#5137433)
Data come from the Twitter Streaming API https://dev.twitter.com/docs/streaming-apis
Re:Tweetping, Twitter traffic in real time by jevinskie on Wednesday January 30, 2013 @03:13AM (#5138601)
Is the site getting the firehose stream though? How do you get that level of access?
Re:Tweetping, Twitter traffic in real time by huskyr on Wednesday January 30, 2013 @04:36AM (#5138743)
They're probably using the 'sample' firehose, which is not protected and still serves a few tweets per second.
Re:Tweetping, Twitter traffic in real time by lucaspiller on Wednesday January 30, 2013 @07:37AM (#5139177)
The free version gives access to 1% [1] of all tweets, which seems about right for this.

[1] https://dev.twitter.com/discussions/2752

Re:Tweetping, Twitter traffic in real time by tariqr on Wednesday January 30, 2013 @05:38AM (#5138889)
that looks like a lot more data than a few tweets per second though.
Re:Tweetping, Twitter traffic in real time by mmahemoff on Tuesday January 29, 2013 @08:21PM (#5137529)
It struck me seeing this how rare it is now to see any kind of Twitter experiment. Complete 180 from a few years back.
Re:Tweetping, Twitter traffic in real time by tibbon on Wednesday January 30, 2013 @02:47PM (#5141350)
Yep. I was part of the Web Ecology Project in 2009-2010 and we were able to get pretty awesome access to Twitter at the time. I had a good dialog on a weekly basis it seemed with their API team and they were super responsive and supportive of us. Although, whenever I asked what we needed to pay for full Firehose (which some companies were getting) I couldn't get an answer from them, and I think they only wanted to talk with huge companies.

Then that all stopped. No more whitelisted IPs for search, no more new whitelisted accounts for API calls, and then they stripped all my whitelisted accounts of their 20k/hr API calls and put them all back at the standard 150/hr or whatever.

And what's worse is the network is bigger than ever. Instead of scaling API access up with network size, they scaled it down. This is really a shame as I think Twitter is terribly interesting to with it from an academic standpoint, but unless you have huge money to shell out for API calls or direct access you're screwed.

Re:Tweetping, Twitter traffic in real time by mochizuki on Tuesday January 29, 2013 @10:42PM (#5137937)
There's so much potential information there, and some very neat things you can do with it. But for me at least, their new API policies completely turned me off of making cool things with it. Not that the API isn't still powerful.
Re:Tweetping, Twitter traffic in real time by incision on Tuesday January 29, 2013 @07:50PM (#5137417)
I'm surprised at the amount of traffic coming from Indonesia. Can anyone offer some insight?
Re:Tweetping, Twitter traffic in real time by pax on Tuesday January 29, 2013 @07:56PM (#5137438)
Indonesia has 4th biggest population in the world. Also, 6th most active country on Twitter (2010).
Re:Tweetping, Twitter traffic in real time by bhauer on Tuesday January 29, 2013 @07:48PM (#5137412)
Very cool! Mind providing some background on how you've rendered the world map and determine tweet coordinates? Are you mapping the tweets' latitude and longitude through some projection formula?
Re:Tweetping, Twitter traffic in real time by hijinks on Tuesday January 29, 2013 @07:56PM (#5137441)
Ya I'd like to know also
Re:Tweetping, Twitter traffic in real time by pzeups on Tuesday January 29, 2013 @08:00PM (#5137461)
It's only geolocated tweets. No projection, just a render with Nodejs w/ Socket.io, Processing.js and Backbone.js !
Re:Tweetping, Twitter traffic in real time by chewxy on Tuesday January 29, 2013 @07:43PM (#5137395)
This was really cool. The office is having internet connectivity problems right now, and after we fixed it, this page loaded, and for a brief moment, I felt like a hacker from the movies :D
Re:Tweetping, Twitter traffic in real time by nhebb on Tuesday January 29, 2013 @09:01PM (#5137649)
Curious about the CPU usage of canvas apps on older systems, I ran this in FF and Chrome. (I'd classify the system I'm on at the moment as a mid-tier business PC from 2008.) FF maintained a CPU usage mostly in the 33-40% range and Chrome in the 18-23% range. CPU usage would spike up to 75-90% in FF, whereas the largest spike in Chrome was only 40%.

It's just one data point, but I was impressed with how much more efficient Chrome was than FF.

Re:Tweetping, Twitter traffic in real time by pzeups on Tuesday January 29, 2013 @09:10PM (#5137675)
That's true! http://blog.lightjs.org/2013/01/svg-canvas-divs/

Chrome is 62% faster than Firefox, Safari 85% and IE10 67%

Re:Tweetping, Twitter traffic in real time by ninetax on Tuesday January 29, 2013 @07:40PM (#5137377)
This is pretty awesome, but I would like to be able to dig in deeper. After looking at it for a couple minutes, there's really nothing more I can do.
Re:Tweetping, Twitter traffic in real time by eltaco on Wednesday January 30, 2013 @04:42AM (#5138755)
I made a project that is similar - shows a bit more information except its only for the US and you need to search a specific word/hashtag. http://tweetpleth.herokuapp.com/
Re:Tweetping, Twitter traffic in real time by wasd on Tuesday January 29, 2013 @07:58PM (#5137451)
Incredibly well done and excellent execution. However, there is a noticeable delay/lag that totally took me out of the user experience. Even though the concept was really cool, I wouldn't mind if everything was slowed down a bit so I get what's actually going on and there was a bit less lag.
Re:Tweetping, Twitter traffic in real time by zobzu on Tuesday January 29, 2013 @08:15PM (#5137513)
I just realized that they don't have twitter in Australia!! ;)
Re:Tweetping, Twitter traffic in real time by simontaotw on Tuesday January 29, 2013 @08:18PM (#5137518)
I think europa should be europe, for correctness's sake
Re:Tweetping, Twitter traffic in real time by olog-hai on Tuesday January 29, 2013 @06:47PM (#5137172)
A pause button would be nice. Also, parts of Australia light up with activity on the map, but strangely it isn't listed on the dashboard.
Re:Tweetping, Twitter traffic in real time by kodablah on Tuesday January 29, 2013 @07:29PM (#5137340)
I believe the regions are defined as the blocks that become visible when you hover over the content title. The Asia one doesn't include Australia.
Re:Tweetping, Twitter traffic in real time by shellehs on Wednesday January 30, 2013 @12:30AM (#5138252)
Are you sure? the webpage showed me these:

----

The following error was encountered while trying to retrieve the URL: http://tweetping.net/

Connection to 91.121.175.82 failed.

The system returned: (111) Connection refused

The remote host or network may be down. Please try the request again.

Your cache administrator is webmaster.

Re:Tweetping, Twitter traffic in real time by pzeups on Wednesday January 30, 2013 @04:13AM (#5138704)
it's back!
Re:Tweetping, Twitter traffic in real time by jdelsman on Tuesday January 29, 2013 @07:01PM (#5137241)
Is it just me, or is it ironic that this site is currently unavailable?
Re:Tweetping, Twitter traffic in real time by dangrossman on Tuesday January 29, 2013 @07:05PM (#5137262)
It's just you. What does visualizing tweets have to do with high availability?
Re:Tweetping, Twitter traffic in real time by madmaze on Tuesday January 29, 2013 @07:06PM (#5137268)
would be nice to have a website for "tweetping traffic in real time(as it gets hit by HN)"
Re:Tweetping, Twitter traffic in real time by pzeups on Tuesday January 29, 2013 @07:38PM (#5137373)
the author is working on it, more you are, more he will improve perf.
Re:Tweetping, Twitter traffic in real time by jusben1369 on Tuesday January 29, 2013 @08:22PM (#5137537)
Nice. I like trendsmap as well. www.trendsmap.com
Re:Tweetping, Twitter traffic in real time by pzeups on Tuesday January 29, 2013 @06:54PM (#5137205)
It's only on geolocated tweets ! Awesome.
Re:Tweetping, Twitter traffic in real time by pax on Tuesday January 29, 2013 @07:52PM (#5137427)
that means the less popular locations get even less exposure, as there are plenty of places in the less developed world of which Twitter location (desktop) is unaware of.
Re:Tweetping, Twitter traffic in real time by ChuckMcM on Tuesday January 29, 2013 @06:39PM (#5137152)
That is fun. A bit scary, but fun.
Re:Tweetping, Twitter traffic in real time by pzeups on Tuesday January 29, 2013 @09:35PM (#5137726)
will be back soon.
Re:Tweetping, Twitter traffic in real time by pzeups on Tuesday January 29, 2013 @09:35PM (#5137725)
back soon.
Re:Tweetping, Twitter traffic in real time by esornoso on Tuesday January 29, 2013 @07:30PM (#5137347)
nice work.
Re:Tweetping, Twitter traffic in real time by lampe on Tuesday January 29, 2013 @07:43PM (#5137393)
nice work!

iam love twitter and right now iam watching a show called #domian and iam looking for that hashtag and there are per minute about 30 tweets and i dont see them on your site. iam from germany.

or did i just overlooked something?