i'm not necessarily familiar with all the services (or the specific dependencies) on that list, but a lot of it will be a knock on effect from e.g: fb login not working as expected

People will very often see it as "service x with fb login is broken"

I work in one of these companies and I can confirm that is a network outage and even our internal tools hosted in our datacenter (so no dependencies with fb) are down

I sincerely hope that AS3356 hasn't broken a big chunk of the Internet again.

https://isc.sans.edu/forums/diary/CenturyLink+Outage+Causing...

https://www.zdnet.com/article/centurylink-outage-led-to-a-3-...

My bet is BGP. Its always BGP.

It's been a while since I studied routing, but have they fixed BGP security?

I remember reading about the protocol and thinking something like: this seems awfully "hippie-trust" levels of security.

Granted, this was 10 years ago so my recollection of BGP is super fuzzy :-D

nope. proper and full implementation of BCP38, MANRS, full RPKI validation of all IP ranges and such is a long distance away.

within trusted groups of ISPs where the admins all know each other, in certain specific geographic regions, it's better than others.. I would say that the number of ISPs I could call "fully compliant" with current best practices, in the Portland-Seattle-Vancouver area, is higher than in many other parts of the world.

How is shaw?

Anecdote: I was surprised to find they honour TTLs on their DNS service. Everyone else I have access to seems to return the new IP almost immediately, but shaw waits it out.

As someone interested in the internal workings of the internet, do you have any further reading on current best practices?

ARIN, RIPE and APNIC publish a great deal of useful documentation on how to set up BGP stuff properly in the modern era. And information for how to fully implement dual stack with ipv6.

As for other current best practices there's really a very great variety of disciplines involved in ISP operations, depending on what type of ISP it is. What's relevant for a GPON FTTH last mile provider might not be as relevant for a colocation/dedicated server ISP. Or for a WISP. My recommendation on that would be to pick the subject to research and make inquiries in the special interest groups dedicated to that (for instance, two way satellite, or automated billing/provisioning systems for hosting companies, or CRM systems, or whatever).

To be fair, BGP only runs between large network operators. The security / trust of routing agreements is mostly solved through business deals and contracts.

Every time this happens I have a mental metaphorical image of somebody tripping over the $5 power strip that has the single point of failure route-server or route-reflector plugged into it.

I stand corrected :)

Any info on what network/operator/operator/etc is suffering the issue? (just so people know about it if it's public, i don't see anything on HN at least)

Thanks, and good luck!

OVH Also having a lot of trouble today .. http://weathermap.ovh.net/ Its a large hosting provider in EU at least.. Not sure the knock on effect.

Yeah, I recently discovered while evaluating Deezer that it doesn't function without scripts from facebook. So, I didn't subscribe.

Solar flare - Solar Cycle 25 is here

https://news.ucar.edu/132771/new-sunspot-cycle-could-be-one-...

https://www.nasa.gov/press-release/solar-cycle-25-is-here-na...

The sun is awakening with ‘solar storms’ that could affect Earth - https://www.washingtonpost.com/weather/2020/12/08/solar-stor...

A Powerful Solar Flare Produces Bright Northern Lights This Week - https://www.forbes.com/sites/ericmack/2020/12/09/a-powerful-...

This has nothing to do with solar flares or cycles.

Root Cause Analysis has determined that solar flares, which come from the Sun, are the reason any life exists on Earth. Without the sun, no technical evolution would have occurred and no outage in Facebook's infrastructure would have happened.

wow... Haven't you heard about the Big Bang?

"In the beginning the Universe was created. This has made a lot of people very angry and been widely regarded as a bad move."

is that sarcasm? because I can play, but only if we confirm this is sarcasm

There are technical limits to how much sarcasm can be understood as such on the Internet.

Narrator: It was not

> causing minor shortwave blackouts

You probably shouldn't try to use Messenger over a shortwave connection.

'Solar Flares'?

I recognize a fellow BOFH...