News for hackers. Stuff that matters.

pietern

Re:A Minimal LRIT GOES Receiver on Wednesday September 26, 2018 @12:11AM (#18072711)
That is awesome to hear! Building this has been a fun side project and I'm happy to hear it sparked interest for you as well.
Re:A Minimal LRIT GOES Receiver on Tuesday September 25, 2018 @11:45PM (#18072616)
Yes, there are multiple interfaces.

This is a nice interactive one: http://rammb-slider.cira.colostate.edu/?sat=goes-16.

There is also an S3 bucket where you can find all data as soon as it is available: https://registry.opendata.aws/noaa-goes/.

But the fun part is receiving it in your backyard, of course ;)

Re:A Minimal LRIT GOES Receiver on Tuesday September 25, 2018 @11:41PM (#18072583)
Great, if you end up building one, keep us updated (here or on Twitter).

1) Yes, this is DCS (Data Collection System) data. It's a very low bandwidth signal (300 or 1200 baud) that ground stations uplink to GOES on UHF. I found there are about 20k separate transmitters in some asset database I once found somewhere. Every one (or the set that's still active) transmits a tiny packet every N minutes (some every minute, others every 30 minutes). This data is also broadcast as part of the LRIT (GOES-15) and HRIT (GOES-16 and GOES-17) streams. There is no processing for this data in the goestools package yet, but you can get the originals and walk over the data. When I last looked at it, the format looked different per receiver, it is possible this is a per-vendor type of thing. Anyway, yes, you can get a copy of this data with the receiver described in the OP guide. See https://github.com/pietern/goestools/issues/11 for some more links.

2) AFAICT MODIS is a product derived from the Aqua and Terra satellites. Both are polar orbiting sats. You can look them up here https://www.wmo-sat.info/oscar/satellites/view/81 and it looks like they don't pack a "direct readout" transmitter, so you wouldn't be able to receive anything directly yourself. Compare this to the page for GOES-16 at https://www.wmo-sat.info/oscar/satellites/view/152 and you see there are a bunch of frequencies with details listed.

Re:A Minimal LRIT GOES Receiver on Tuesday September 25, 2018 @06:16PM (#18071016)
Depends on the mode the satellite is operating in. Typically: a full disk image every 15 minutes, the continental USA every 5 minutes, and two selected "mesoscale" regions (they will move around based on interesting events) every minute or even 30 seconds. Not all these products are relayed through this downlink though. On HRIT you'll find a full disk image across 7 different spectral bands every 30 minutes, and mesoscale images across 3 different spectral bands every 15 minutes.

Next to this data, it also contains relayed images from GOES-15 (GOES-West), Himawari-8, EMWIN data, and NWS forecasts and plots.

Re:A Minimal LRIT GOES Receiver on Tuesday September 25, 2018 @04:46PM (#18070333)
Hi everybody, cool to see this submitted on HN. I'm around for questions so ask away.

Also beware that the guide is a little out of date:

1) the listed antenna is no longer available, but there are comparable ones for comparable or lower price, and

2) the SAWBird has been generally available for a couple of weeks.

Re:A Minimal LRIT GOES Receiver on Tuesday September 25, 2018 @04:43PM (#18070311)
It's not. The SUVI data is not broadcast on the HRIT feed, only on the GRB (GOES ReBroadcast) feed. Receiving GRB requires more effort: minimum 10ft dish, dual circular polarized feed, DVB-S2 demodulator, and different software. Never tried this, but would make for a fun project.
Re:Facebook Trains ImageNet in 1 Hour on Tuesday June 13, 2017 @12:46PM (#14546196)
Re: your second point, it is strictly synchronous, though since there are 8 GPUs per process (thus have 1 process per machine) the gradient reduction is done in 3 phases. First they are reduced within the process, then across processes/machines, and then broadcast within the processes.
Re:Facebook Trains ImageNet in 1 Hour on Tuesday June 13, 2017 @12:43PM (#14546161)
Hi Salvatore! :D

And there's even a tiny Redis dependency (optional though) in the code to generate these results. In particular the collective communication library needs a rendezvous phase where all nodes connect to their peers. Using Redis for this is one of the options. See: https://github.com/facebookincubator/gloo/tree/master/gloo/r...

Re:Facebook Trains ImageNet in 1 Hour on Tuesday June 13, 2017 @01:11AM (#14542961)
Interconnect between the servers is 50 Gbit Ethernet (see section 4 of the paper).
Re:More Redis internals: Tracing a GET & SET on Thursday March 10, 2011 @05:04PM (#2311003)
Or set the OPTIMIZATION environment variable for even more control ;-)
Re:Redis: the AK-47 of databases on Friday January 28, 2011 @09:44AM (#2151946)
It's called optimistic for a reason. You assume there is low contention and configure your client to have random back off.
Sorry about that, just deployed a fix to make it less likely for session identifiers to collide. Shouldn't happen again.
All keys are namespaced to a unique session identifier, so parallel sessions are isolated. You can check out the code for the interactive stuff here: https://github.com/antirez/redis-io/tree/master/lib/interact...