News for hackers. Stuff that matters.
Re:Flightradar24 – how it works by RivieraKid on Sunday February 17, 2019 @03:15PM (#19186578)
Not a big fan of "data monopolies" like Flightradar24. It's as if OpenStreetMaps was a private company that capitalizes on being first into the space and having a community of contributors willing to supply data to a private company for free. I hope an open data project such as https://www.adsbexchange.com/ wins in the long-term.
Re:Flightradar24 – how it works by coin on Sunday February 17, 2019 @10:17PM (#19188375)
Completely agree. FR24, along with FlightAware, Radarbox24 and Plane Finder has built a business of monetizing free, crowdsourced data. For FR24 there's been multiple requests by the community to for an API, some willing to pay, but they've refused every time. I don't understand why people are eager to feed into those closed network.

ADSB Exchange on the other hand is built with an open premise, runs off donations, and encourages third-party app and value add to build off their API.

Re:Flightradar24 – how it works by vinay427 on Sunday February 17, 2019 @10:52PM (#19188506)
Well, we can do both. FlightAware has nice tutorials and client software for setting up an ADSB feeder on a Raspberry Pi, but I feed to ADSB Exchange as well with minimal extra effort.
Re:Flightradar24 – how it works by closetohome on Monday February 18, 2019 @12:41PM (#19192455)
They also started out with a fairly expensive premium app, and then jettisoned it in favor of a subscription-based service, leaving everyone who bought the app high and dry.
Re:Flightradar24 – how it works by chrissnell on Sunday February 17, 2019 @11:46PM (#19188706)
There's probably not much stopping FR24 from feeding off of ADSB Exchange. This happens in the weather world, where data from community-managed CWOP weather stations ends up in the hands of commercial weather data services, who normalize the feeds and incorporate them into their forecasting products.
Re:Flightradar24 – how it works by freeflight on Monday February 18, 2019 @04:41AM (#19189580)
Isn't there some kind of "free to use, but not to commercialize" license the CWOP people could be releasing their data under?
Re:Flightradar24 – how it works by djsumdog on Monday February 18, 2019 @01:00PM (#19192648)
That gets into the very tricky idea of "What is commercialization?" If you use a Creative Commons works that's BY-NC on your blog, but your blog runs ads, is it now commercial? What if it's funded by Patreon? That's why Wikipedia doesn't allow NC and the premise behind the Free Culture licenses.
Re:Flightradar24 – how it works by Rebelgecko on Sunday February 17, 2019 @04:24PM (#19187002)
There's also https://opensky-network.org/

Their API is actually a bit more open than adsbexchange's

Re:Flightradar24 – how it works by bicubic on Sunday February 17, 2019 @06:49PM (#19187658)
How is the data coverage compared to flightradar?
Re:Flightradar24 – how it works by Rebelgecko on Sunday February 17, 2019 @08:10PM (#19187985)
Last time I looked closely it was similar in North America and Europe. Asia, Africa, and over the oceans had some pretty big gaps.

There's also no delay on the data, although I think Flightradar and Flightaware dropped the 5 minute delay they used to have. Flightradar censors a lot of corporate jets and military/law enforcement aircraft but I don't think Opensky does. In fact one of either Opensky or adsbexchange even has a special flag in their REST API for "interesting" aircraft

Re:Flightradar24 – how it works by black-tea on Monday February 18, 2019 @03:25AM (#19189288)
> Flightradar censors a lot of corporate jets and military/law enforcement aircraft

Yes, this is disappointing. In the past I had seen military planes on there. I even saw fighters practising dogfighting over the North Sea. But more recently I've seen interesting aircraft fly over, such as large four-engine planes at altitude outside of normal commercial flight paths, but they just don't appear on flightradar. It's stupid because I can see the damn thing. I need to figure out an alternative to flightradar, it seems.

Re:Flightradar24 – how it works by JoeDaDude on Monday February 18, 2019 @12:17PM (#19192220)
Some activists were using this kind of service to track dictator's flights to track stolen money [1]. If said dictator's can block their aircraft, the misappropriated funds would be easier to sneak out of the country.

[1] https://news.ycombinator.com/item?id=12700445

Re:Flightradar24 – how it works by freeflight on Monday February 18, 2019 @04:50AM (#19189621)
ADS-B Exchange [0] has a tag for military aircraft, right now it's showing a whole bunch of military aircraft (German, Belgium, Norway, Netherlands, UK, US) over central Europe.

[0] https://global.adsbexchange.com/VirtualRadar/desktop.html

Re:Flightradar24 – how it works by Moru on Monday February 18, 2019 @10:34AM (#19191366)
Note that even the Swedish spy plane is using Ads-b while flying along the baltic International border zone taunting Russia but the migs answering the taunt is not. Also flying dangerously close to the spy plane (10 m reported once). However the US spy planes are also mostly flying with the transponder on there.
Re:Flightradar24 – how it works by black-tea on Monday February 18, 2019 @05:06AM (#19189686)
Cool, that looks much better, thanks.
Re:Flightradar24 – how it works by Zhenya on Sunday February 17, 2019 @08:53PM (#19188131)
Using their UI, I can't seem to find the "interesting aircraft" tag. Here's what I see:

  * No data
  * No ADS-B Emitter Category Information
  * Light (<15500 lbs)
  * Small (15500 to 75000 lbs)
  * Large (75500 to 300000 lbs)
  * High Vortex Large (aircraft such as B-757
  * Heavy (> 300000 lbs)
  * High Performance (> 5g acceleration and 400 kts)
  * Rotorcraft
  * Glider / sailplane
  * Lighter-than-air
  * Parachutist / Skydiver
  * Ultralight / hang-glider / paraglider
  * Reserved
  * Unmanned Aerial Vehicle
  * Space / Trans-atmospheric vehicle
  * Surface Vehicle – Emergency Vehicle
  * Surface Vehicle – Service Vehicle
  * Point Obstacle (includes tethered balloons)
  * Cluster Obstacle
  * Line Obstacle
Re:Flightradar24 – how it works by Rebelgecko on Sunday February 17, 2019 @09:12PM (#19188185)
Yeah that was actually with adsbexchange (https://www.adsbexchange.com/currently-airborne-interesting-...).
Re:Flightradar24 – how it works by Tepix on Monday February 18, 2019 @04:08AM (#19189453)
That's really interesting, there are two Project Balloons high over the Brasilian Amazon.
Re:Flightradar24 – how it works by rootusrootus on Sunday February 17, 2019 @08:49PM (#19188120)
The delay was a rule from the FAA for radar data provided by them, ADS-B plots have always been real-time. I am guessing (from the lack of orange icons anymore) that the ADS-B coverage is good enough now that FR24 is not using FAA feeds any more.
Re:Flightradar24 – how it works by graedus on Sunday February 17, 2019 @08:52PM (#19188130)
> I think Flightradar and Flightaware dropped the 5 minute delay they used to have

I was using Flightradar yesterday and visually tracking planes, seems like about a 10 second delay.

Re:Flightradar24 – how it works by corford on Monday February 18, 2019 @11:35AM (#19191862)
"Data monopoly" implies FR24 have exclusive use and control over the ADS-B feeders. This simply isn't the case. There's nothing stopping you feeding your data to other sites/apps. Also (as is the case with flight aware), all users providing ADS-B data get free subscriptions to the paid for parts of FR24s service.

Building an app, maintaining a website (that has something like 2 million daily users iirc) and building out backend infra to support the huge amount of incoming data and turn it into something greater than the sum of its parts costs money. What many people don't realise is the data you see on FR24 is not simply derived from ADS-B broadcasts. Data like fight numbers comes from other licensed sources; MLAT triangulation is done at FR24's end; telemetry data for areas without community ADS-B coverage comes from partnerships with radar operators, airports (and soon satellite, when Aireon is active) etc.

If you're curious to know what raw info is included in a typical broadcast, this is a good link: https://www.adsbexchange.com/datafields/

Re:Flightradar24 – how it works by closetohome on Monday February 18, 2019 @12:40PM (#19192443)
> There's nothing stopping you feeding your data to other sites/apps

Except the TOS, if you're using one of their receiver kits.

Re:Flightradar24 – how it works by corford on Monday February 18, 2019 @03:37PM (#19194190)
Don't use one of their kits...
Re:Flightradar24 – how it works by maxerickson on Sunday February 17, 2019 @09:41PM (#19188258)
Note that the OpenStreetMap Foundation is a private company (it's not a for profit company, but it's organized as a company under UK law), probably is the first (at least large scale general purpose) crowd sourced map, and supplies data for free to anyone that meets the terms of the ODBL.
Re:Flightradar24 – how it works by spookthesunset on Sunday February 17, 2019 @03:41PM (#19186753)
Flightradar24 is probably one of the better flight trackers out there. It is well supported and has a polished easy to use interface.

They are only a “data monopoly” because they are good at what they do.

Re:Flightradar24 – how it works by RivieraKid on Sunday February 17, 2019 @04:25PM (#19187010)
Not sure if you mean easy to use interface for contributors or for users. I can only judge the second, and the website is "meh"... it's kind of slow and the UI and design is underwhelming.

In any case, being good at what they do definitely helps, but network effects is also a factor. They have the best data coverage, therefore new contributors will mainly chose them over a hypothetical competitor with a slightly better support and user interface.

This discourages new competitors to even try entering the market, which has the usual downsides of a monopoly market such as less innovation.

Re:Flightradar24 – how it works by dewey on Sunday February 17, 2019 @03:20PM (#19186620)
I thought it would be cool to have some kind of gateway service that collects the data and then sends if off to adsbexchange, flightradar and others but apparently it's not so easy.

Someone else already asked this question before:

https://www.reddit.com/r/ADSB/comments/ar3qrw/feed_to_a_sing...

Re:Flightradar24 – how it works by sorenjan on Sunday February 17, 2019 @03:54PM (#19186843)
Do you mean collect data from multiple receivers and send it off to various services from one computer? That messes with MLAT [0] calculations and shouldn't be done.

If you want to send data to multiple services from one receiver all you need is to install the feeder for each service. Most uses dump1090 [1], but Flightradar24 uses their own. Dump1090 sends data in different formats to various local ports by default, and ADS-b Exchange uses netcat to send it to their server. You can use the ADS-B Receiver Project [2] to install everything needed.

[0] https://en.wikipedia.org/wiki/Multilateration

[1] https://github.com/flightaware/dump1090

[2] https://github.com/jprochazka/adsb-receiver

Re:Flightradar24 – how it works by loeg on Sunday February 17, 2019 @04:52PM (#19187145)
Do you have more detail on how collection messes with MLAT calculations? It seems like for triangulation purposes, each device should produce some precise timestamp that is not affected by store-and-forward transmission.
Re:Flightradar24 – how it works by sorenjan on Monday February 18, 2019 @12:59AM (#19188898)
I don't think the programs are made to handle that use case. At present you register your receiver's location with the server once and send packets as they arrive, that server doesn't know that your packets are from multiple receivers at multiple locations.

https://discussions.flightaware.com/t/aggregation-of-dump109...

https://github.com/mutability/mlat-client

Re:Flightradar24 – how it works by theyinwhy on Sunday February 17, 2019 @04:59PM (#19187174)
Unfortunately, there is no good solution for this. Either you rely on the time settings of the sender or on the time needed to transmit the data and on the time the data gets transmitted.
Re:Flightradar24 – how it works by wbl on Sunday February 17, 2019 @06:51PM (#19187663)
A radio receiver with a GPS time base doesnt seem that tricky.
Re:Flightradar24 – how it works by lmz on Sunday February 17, 2019 @07:07PM (#19187729)
If we assume the sender is not malicious, a properly configured NTP client ("the time settings of the sender") would probably suffice. If the sender is malicious, unless you somehow make the "signal + timestamp" from the receiver non-modifiable from the receiver to the service, you've lost anyway.
Re:Flightradar24 – how it works by toomuchtodo on Sunday February 17, 2019 @07:33PM (#19187844)
Because MLAT relies on multiple devices, it should be straightforward to identify and blacklist a sender tampering with timing data.
Re:Flightradar24 – how it works by dewey on Sunday February 17, 2019 @04:01PM (#19186886)
Thanks for the explanation. I was referring to the second use case and I didn’t know it’s so easy. So I guess it’s not that big of a problem.
Re:Flightradar24 – how it works by bnchdrff on Sunday February 17, 2019 @09:32PM (#19188239)
If you aren't trying to send MLAT data to more than one server, it isn't an issue. You can do MLAT to, say, adsbexchange, and non-MLAT to flightradar24.
Re:Flightradar24 – how it works by sorenjan on Monday February 18, 2019 @01:03AM (#19188910)
You'd still need to send the mlat messages from each receiver though, you can't aggregate them from one computer since there's no position included in the sent messages. And I don't know why it would be a problem to feed from each receiver, they need connectivity any way.
Re:Flightradar24 – how it works by kaybe on Sunday February 17, 2019 @03:21PM (#19186625)
Is there an open version for ship data as well?
Re:Flightradar24 – how it works by NelsonMinar on Sunday February 17, 2019 @06:03PM (#19187460)
Last I checked there AISHub was the biggest reusable source of AIS data. Coverage map here: http://www.aishub.net/coverage. They are used by various sites like https://www.vesselfinder.com/

MarineTraffic has a more comprehensive monitoring network but they keep the data to themselves. Details at https://www.marinetraffic.com/en/p/expand-coverage

As noted by another comment, AIS signals are being broadcast line-of-sight from the ground so you need more receivers than you do to track airplanes. OTOH you only need the receivers on the coastlines and on major inland waterways, not over the whole earth's surface. (If you want to track a ship mid-ocean, you'll need a satellite. Those exist but cost $$.)

Re:Flightradar24 – how it works by dewey on Sunday February 17, 2019 @03:23PM (#19186642)
Re:Flightradar24 – how it works by kaybe on Sunday February 17, 2019 @06:02PM (#19187459)
Great! They don't seem to have historic ship positions though.. hm.
Re:Flightradar24 – how it works by benoblak on Sunday February 17, 2019 @08:11PM (#19187993)
It seems like none of the AIS providers store historic ship positions, you probably have to do it yourself if you want that information
Re:Flightradar24 – how it works by dzhiurgis on Sunday February 17, 2019 @04:13PM (#19186944)
It seems possible to make AIS receiver using RTL-SDR + RPI. I am about to make it, there's a couple of guides online.
Re:Flightradar24 – how it works by chancecarey on Sunday February 17, 2019 @04:45PM (#19187113)
AIS isn’t long range though. You’d need an incredible amount of base stations for any sort of decent coverage of frequented areas.
Re:Flightradar24 – how it works by dzhiurgis on Sunday February 17, 2019 @06:04PM (#19187464)
50k radius if not more off a 10 sailboat mast. In context of sailing boat that you only meed couple of kilometers.

BTW new Iridiums are capturing AIS and ADS-B from satelite.

Re:Flightradar24 – how it works by codedokode on Monday February 18, 2019 @07:47AM (#19190265)
Also, Flightradar hides some of the data from public view [1].

[1] https://www.flightradar24.com/business/aircraft-unblocking

Re:Flightradar24 – how it works by MarcysVonEylau on Monday February 18, 2019 @05:55AM (#19189874)
You are always welcome to feed more than one service. Even when you get a free receiver from the company, nothing stops you from repurposing the data and feeding elsewhere.