News for hackers. Stuff that matters.
Re:Is BGP Safe Yet? by tptacek on Friday April 17, 2020 @11:53AM (#22900084)
It would be interesting to read more about the problems with RPKI. The set of organizations that need to implement RPKI to make it effective is pretty small, and yet it's been a long slog to get it even to this point. It's not like network engineers at Google, Comcast, and Verizon are unfamiliar with it. What's going wrong?
Re:Is BGP Safe Yet? by pathseeker on Friday April 17, 2020 @01:08PM (#22900825)
RPKI doesn't sign hops in the path for a BGP update. That means to hijack a prefix, all you need to do is to take a legitimate route and re-advertise it with your AS as the second hop in the path.

This isn't as damaging as being able to advertise a smaller prefix because it won't send all traffic to you. It will just send from routers where your path is shorter than the original.

To actually prevent hijacking via path shortening attacks like this, you need a full BGPSEC implementation https://en.wikipedia.org/wiki/BGPsec which is a much higher barrier than RPKI because the crypto operations jump 1 or 2 orders of magnitude (signing every re-advertised route rather than just originated routes).

So RPKI gets the cert infra in place, but it doesn't really fully solve the problem.

Re:Is BGP Safe Yet? by korethr on Friday April 17, 2020 @01:34PM (#22901107)
But, with RPKI getting the cert infra in place, would that not then make it relatively easier to take that 2nd step, than when not even RPKI was in place?
Re:Is BGP Safe Yet? by topranks on Saturday April 18, 2020 @10:13AM (#22907861)
The problem is the number of updates / changes that happen all the time in BGP, and having each router cryptographically validate each one / sign every update it sends.... it doesn’t scale well.

The BGPSEC theory is there but not sure if we can make a workable system.

https://www.potaroo.net/ispcol/2011-07/bgpsec.pdf

Re:Is BGP Safe Yet? by mlyle on Saturday April 18, 2020 @07:51PM (#22912139)
Current routers can't handle it, but ... it's not like routes changes that much that we're talking about an intolerable amount of RSA operations. We're really talking about fewer operations per day per router than some web frontends do in a second.
Re:Is BGP Safe Yet? by tptacek on Saturday April 18, 2020 @09:08PM (#22912582)
That doesn't sound right? In 2018 there were, according to Geoff Huston, days with 700,000 updates per day. That sounds high for handshakes/second.
Re:Is BGP Safe Yet? by mlyle on Sunday April 19, 2020 @02:40AM (#22914042)
OK, OK, my bad; a single large multicore NGINX box can only do about 100k full TLS handshakes per second with 2048 RSA. So it'd be several seconds.

On the other hand, verify is cheaper. My crappy laptop will do ~320k RSA-2048 verifications per second...

Re:Is BGP Safe Yet? by mititelu on Sunday April 19, 2020 @03:27PM (#22918167)
https://www.nginx.com/wp-content/uploads/2014/07/NGINX-SSL-P....

350 per core per second... you are way off at 100k/s.

If there is such a thing I'd really like to see setup to get it running / try it out myself as well.

do note there are ways to cache ssl data so connections are resumed / avoid handshake again for same user

Re:Is BGP Safe Yet? by mlyle on Sunday April 19, 2020 @03:37PM (#22918227)
https://www.nginx.com/blog/testing-performance-nginx-ingress...

60k/second across 24 cores, admittedly on very fast hardware (though not using all the cores that hardware has). Pretty much the same number on 16 cores.

In general, telling someone they're "way off" about performance and citing 6 year old benchmarks isn't a winning plan.

In any case, it's immaterial to what we're discussing. My slow laptop could verify all the signatures for a busy day of updates in a couple seconds, and it's clearly -possible- to put a big fraction of this horsepower in a router.

Re:Is BGP Safe Yet? by mititelu on Monday April 20, 2020 @05:41AM (#22922446)
Thanks for the reference, new benchmark looks nice.

Apologize for the 'way off', its reach-able.

And agree its immaterial to signature checks, but since it was brought up...

Either way, there is probably something holding routers back from reaching that, would be fun to speculate.

Re:Is BGP Safe Yet? by londons_explore on Friday April 17, 2020 @02:53PM (#22901779)
A modern CPU can do how many thousands of signatures per second?

How many internet routes change per second?

How many dollars per second would pay for enough CPU's to sign every changed route? I'd bet less than one... I'd guess 1000x less than one...

Re:Is BGP Safe Yet? by bifrost on Friday April 17, 2020 @03:18PM (#22902055)
Routers don't typically use PC cpus.
Re:Is BGP Safe Yet? by job on Friday April 17, 2020 @03:36PM (#22902237)
For the BGP portion of the work they absolutely do.
Re:Is BGP Safe Yet? by bifrost on Friday April 17, 2020 @04:10PM (#22902511)
Took me a minute to realize you were Job Snijders too lol.

We both know there are still garbagey nets out there using ARM32, MIPS and who knows what else out there for control plane processing. Only the big guys are gonna upgrade to support this.

Re:Is BGP Safe Yet? by bifrost on Friday April 17, 2020 @03:52PM (#22902366)
I'm not sure which platform you're talking about, mine uses PPC, which hasn't been in a desktop in quite some time.

kern.version: JUNOS 18.XXX.X #0: XXXX-XX-XX 03:28:10 UTC builder@svl-junos-p001:/volume/build/junos/18.X/release/18.XXX.X/obj/powerpc/junos/bsd/kernels/JUNIPER-PPC/kernel

There certainly are some routers that use x86 based CPUs, but they're embedded versions which you'd be unlikely to use on a PC.

Re:Is BGP Safe Yet? by job on Friday April 17, 2020 @04:27PM (#22902647)
You can easily do origin validation on that type of CPU. It’s a very efficient lookup.
Re:Is BGP Safe Yet? by bifrost on Friday April 17, 2020 @05:02PM (#22902952)
I guess we'll see what happens TBH. I didn't realize it'd been available in JunOS since 12.2 which covers a variety of devices (even some old stuff I've seen on customer sites), I've yet to come across a site with it deployed. Maybe I should do some consulting for folks.
Re:Is BGP Safe Yet? by Hikikomori on Friday April 17, 2020 @09:23PM (#22904553)
Big isp core and edge routers absolutely use large Xeon CPUs.
Re:Is BGP Safe Yet? by bifrost on Monday April 20, 2020 @02:03PM (#22926546)
If you count a single multicore 1.9Ghz CPU as a "Large Xeon" then you'd be right, otherwise thats incorrect.
Re:Is BGP Safe Yet? by Hikikomori on Monday April 20, 2020 @07:22PM (#22930001)
8 cores in Cisco rsp880, released a few years ago so not that small back then.
Re:Is BGP Safe Yet? by londons_explore on Friday April 17, 2020 @04:44PM (#22902787)
Nothing stops you hooking up a regular PC to do route validation and run the BGP protocol and stuff, and load validated routes into any router you choose.
Re:Is BGP Safe Yet? by bifrost on Friday April 17, 2020 @04:51PM (#22902863)
There are lots of things stopping that...

The first namely being that nobody is going to do that unless they have too much time on their hands and don't actually run a real network. "Just loading routes" into a router is not really that straightforward.

Re:Is BGP Safe Yet? by az656 on Sunday April 19, 2020 @06:55AM (#22914928)
A lot of people, including very large companies are doing this in production. Using a route reflector/route server isn’t new, and it is very common.
Re:Is BGP Safe Yet? by bifrost on Monday April 20, 2020 @02:01PM (#22926530)
Doing it right is not easy, and most people don't do it correctly nor do they know how to make it work all the time.
Re:Is BGP Safe Yet? by londons_explore on Saturday April 18, 2020 @12:42PM (#22908903)
Isn't that the entire idea behind the "software defined networking" craze?
Re:Is BGP Safe Yet? by bifrost on Monday April 20, 2020 @02:00PM (#22926522)
There's certainly an aspect to that, but generally no.
Re:Is BGP Safe Yet? by skissane on Friday April 17, 2020 @04:32PM (#22902697)
> mine uses PPC, which hasn't been in a desktop in quite some time

Raptor sells desktops with IBM POWER9 CPUs – https://www.raptorcs.com/content/base/products.html – they are expensive, and the same amount of money would buy you a much more powerful x86 system, but they exist.

Re:Is BGP Safe Yet? by corndoge on Friday April 17, 2020 @12:20PM (#22900323)
The same thing that's going wrong with IPv6 adoption.

Edit: It's true. RPKI works, it's just harder to use than not using it, and network engineers have been doing bgp without rpki since forever. Managing PKI is outside the scope of a Cisco flat file and so it's not getting done. Route maps are easier to write than managing PKI. In the same vein IPv4 networks work and have been done since forever and as long as it's easier to shim over your v4 core and do carrier NAT and memorize dotted quads v6 will not get done with haste.

Re:Is BGP Safe Yet? by job on Friday April 17, 2020 @03:42PM (#22902289)
I've made an actual study of implementing RPKI's outcome in the route-map language, and its not pretty: https://github.com/job/rpki-ov-route-map

I recommend using RTR and native origin validation, not to depend on the route-map language to accomplish the task ;-)

Re:Is BGP Safe Yet? by eastdakota on Friday April 17, 2020 @12:20PM (#22900326)
The excuse used to be there wasn’t adequate tooling. That’s changed over the last 18 months. See, for example, the open source GoRTR tool our team released:

https://github.com/cloudflare/gortr

And the fact that major ISPs with complex networks like AT&T, NTT, and Telia have implemented it proves it’s possible.

Re:Is BGP Safe Yet? by q3k on Friday April 17, 2020 @01:04PM (#22900790)
Certainly ARIN being weird [1] and not allowing to distribute their TAL (~CA cert, but for RPKI ROAs), or resulting RPKI data freely doesn't help.

[1] - https://www.arin.net/resources/manage/rpki/rpa.pdf

Re:Is BGP Safe Yet? by SEAthr0waway on Friday April 17, 2020 @01:50PM (#22901244)
There's a few challenges with the adoption/deployment of RPKI.

Remember, there are two parts here: -Signing your IP address space (generating ROAs to reference your Origin ASN and Max Prefix Length). -Implementing Origin Validation in your network (getting an RPKI validator, grabbing ROAs, talking RTR to routers).

There's also another aspect here worth calling out. Which is that RPKI at the moment doesn't address path validation. Basically, stopping routing leaks or addressing as-path spoofing. AS Path Authorization is still in the early days at the IETF, but the idea is people can piggyback off the existing RPKI infrastructure to implement it without making any major changes. Some folks will say because there is no ASPA - that Origin Validation isn't worth the effort, but I disagree with that - any bit helps to stop hijacks.

Going back to ROA generation, there are two ways to sign announcements. You can go to your RIR and use their APIs or website to do it. Some of the RIRs have okay APIs, some are not so great (which is a pain if you are into automation). You can run in delegated RPKI mode and do your own CA, but that is a fair amount of work and only a few people on the planet do it (but props to those people who have open sourced the s/w and making this easier). The other two challenges with ROA generation are that if you screw it up, it's real painful to unwind. Revoking the ROA can take hours to take effect, or publishing a new/corrected ROA can take hours. If you screw up and specify the wrong ASNs (or lets say you migrate ASNs over), or screw up the max prefix length, you can invalidate your address space on the Internet and blackhole yourself. The other issue is with ARIN - specifically the fact that people running RPKI validators have to deliberately accept the ARIN Trust Anchor for legal reasons (ARIN indemnification). There is evidence that some people are installing the validators and not adding ARINs trust anchor, resulting in not accepting any ROAs that went through ARIN - which is a big chunk of the Internet.

As for Origin Validation, there have been some great open source efforts in the last few years to make this easier to adopt (and big thanks to those whove lowered the bar here). That said, it still means building/deploying this in a robust way, enabling RTR on all your routers and writing policy to reject invalids. It's just a bunch of work and for some networks, it takes time to roll that out globally. Then there is the question of which routes do you apply validation on? What if your have customers who screwed up ROAs? Now you have to coordinate and get them to clean up their game before you turn on the switch or poke holes (nasty). Finally, you have to agree that you are going to essentially drop invalid prefixes for destinations on the Internet. That means if someone on the other side of the world screws up a ROA, you're not routing to them. You've got to be prepared to tell a customer why they can't reach their destination on your network, but another network without origin validation can (like a competitor).

that said, there is no reason to not sign your address space today and start rolling origin validation. there are a number of network operators in the right spots (irc, mailing lists) who are there to help you and give you guidance if you need it.

ps - hi tom. i still have your enteract card from years ago and recall meeting you a few times at the third coast cafe.

Re:Is BGP Safe Yet? by tptacek on Friday April 17, 2020 @03:39PM (#22902263)
Whoah. Don't leave me hanging like that! My email's in my profile.
Re:Is BGP Safe Yet? by dsl on Friday April 17, 2020 @01:59PM (#22901316)
IRRs already solves this problem. RPKI just adds crypto because hand waving reasons.

Providers won't implement RPKI for the same reason they haven't implemented IRR filtering or BCP38 for the last 10 years. It adds operational overhead, adds another thing that might go wrong, and there is no financial incentive.

Re:Is BGP Safe Yet? by kitteh on Friday April 17, 2020 @03:03PM (#22901892)
IRR has data issues. RIRs put some control around this (tying prefix to org), but plenty of trash in the other IRRs (people claiming they own /12s they don't, etc). Also the chain of people using as-sets to mark who their customers are is busted. People are being way too broad by putting peers in their set for networks that aren't their transit customers - and prefixes get permitted.

The BCP38 war is lost. Credit to those who try to do better but it's the hosting shops who are the biggest offenders. Most broadband and cloud providers do this proper. I chase down tcp syn reflection attacks and they always come from the same types of hosters.

Re:Is BGP Safe Yet? by topranks on Saturday April 18, 2020 @10:15AM (#22907880)
IRR is too messy and too many conflicts.

RPKI is a lot saner thing to be using.

Re:Is BGP Safe Yet? by topranks on Saturday April 18, 2020 @10:04AM (#22907793)
Nothing. It’s relatively new and is getting more adoption all the time.

There are like 70,000 ASNs out there, so a lot of orgs need to implement. But you’re right, if all the Tier 1’s do it we’ll be in a good place.

The “problem” with it is it doesn’t solve the path validation problem, so while it helps it doesn’t fix BGP completely.

Re:Is BGP Safe Yet? by tptacek on Saturday April 18, 2020 @02:30PM (#22909941)
Relatively new? Isn't it something close to 10 years old now?