News for hackers. Stuff that matters.
[dead]
Re:Reconstructing Twitter's Firehose by djakjxnanjak on Wednesday February 27, 2019 @09:11PM (#19268502)
It probably is! When your bottleneck is a remote API limit, CPU usage might not be worth optimizing.
Re:Reconstructing Twitter's Firehose by stuck_in_matrix on Wednesday February 27, 2019 @09:17PM (#19268521)
Python is perfectly fine for these type of tasks. I ingest all of Reddit in real-time (https://pushshift.io) and also ingest Gab.com and several others (Stackoverflow, etc.) and at most one or two CPU cores are at 10-15%.

Also, when I provide code examples, I try and use a language that most programmers will have some exposure to and generally Python is high on that list.