News for hackers. Stuff that matters.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @05:41PM (#26640907)
Disclaimer: worked for Meraki (now Cisco Meraki) for several years.

Generally, halfway decent wireless APs are all targeted at the enterprise market. Consumer hardware is a brutal race to the bottom, as lay consumers aren't qualified to compare options based on anything but price and UI. Ubiquiti was an outlier in trying to bring enterprise features to the consumer market

The problem for enthusiasts and small business/home office setups like yours are that both the enterprise market (e.g. Meraki) and the premium consumer market (e.g. Google WiFi) focus heavily on ease of management - cloud controllers are table stakes these days, not a controversial feature. Part of that premium that Meraki, Aruba, and that class of enterprise supplier charge is about having a trustworthy and secured backend.

Note, however, that roaming between APs is a feature of the 802.11 standard; you just need to have all your APs on the same layer 2 (802.x) network, and using the same SSID and credentials. No fancy hardware required, and you can even mix and match vendors.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by SV_BubbleTime on Tuesday March 30, 2021 @06:02PM (#26641141)
My personal experience with Meraki has been the very definition of vendor lock-in.

The security appliance was relatively cheap, then we saw the fine print that the total bandwidth was artificially limited and increased only adaquetly two product levels up. Sorry Mr BubbleTime, you need to buy a new applicance and a new license. Your old one is worth nothing and non-transferable, watch it rot.

The switches seem absurdly expensive when you consider the 5-7 year licensing costs. And the quality is poor at best considering Meraki went and pushed a firmware update that bricked every fan in every 48 port switch we had. But you have the security appliance so it “only makes sense” to pay for these switches.

We had an IPSEC incompatibility between a vendor with an ASA and our Meraki gear. The solution was to buy a Cisco device just for that one connection.

All in all, it’s passable, but because of the lock-in it’s not like I have a cost effective choice to get away from it. I wouldn’t chose it again.

That said, it does offer a mediocre IT tech a single pane of glass they have to try to mess up.

Of all the Meraki factors I’ve learned and considered, that it is cloud-based is the least important towards my recommendation or lack of. There are lots of people that would be happy to explain all the ways my experience is wrong, but whatever.

Short version, I wouldn’t do it again.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by jlawer on Tuesday March 30, 2021 @06:11PM (#26641222)
Completely agree with the lock-in, and they aren't the best / featureful device out there. It seems the sweet spot for them is places with LARGE distributed footprints (such as retailers), where you can have very simple networking (some back to HQ, the rest to internet).

It fits well with being able to rapidly bring bodies into a project and implement change X across hundreds of stores, while having a standing IT team of 5.

If you have onsite (fulltime) IT, its likely not the best option.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by foobiekr on Tuesday March 30, 2021 @06:38PM (#26641433)
Is there a community for this kind of discussion at this point? When I was an admin, and then later working in networking in the 2000s, there were tons of very active mailing lists, not just for hardcore networking but for IT-oriented stuff, mostly all faded to a shadow of their former selves.

I'd be particularly interested in comparisons of Meraki/Mist/etc. for small enterprise and campus.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Silhouette on Tuesday March 30, 2021 @07:15PM (#26641718)
Some of the relevant subreddits have decent discussions from time to time. The grandfather is /r/networking, but if you look at its sidebar, there's a long list of other subreddits for more specific subjects and individual brands. Stick to the subs for professionals rather than minor home network issues and you'll find quite a few knowledgeable people and plenty of anecdotes both good and bad about different brands etc.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by foobiekr on Tuesday March 30, 2021 @09:10PM (#26642453)
thanks
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @07:20PM (#26641752)
"Cloud-based" is the implementation; the killer feature is the single pane of glass. It's just hard to implement that without putting a bunch of logic in the cloud.

Last I worked at Meraki was 2015; I don't remember any artificial limiting of bandwidth at that time.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Silhouette on Tuesday March 30, 2021 @08:03PM (#26642047)
"Cloud-based" is the implementation; the killer feature is the single pane of glass. It's just hard to implement that without putting a bunch of logic in the cloud.

Hard in what way? As long as the control traffic has paths between all relevant devices over the management LAN, why does the cloud need to be used at all?

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @08:19PM (#26642137)
1. Putting the management UI on a local system requires some custom networking setup, and is full of security footguns.

2. Most customers who want this have multi-site setups; in that case, you need paths across the public internet too. Again security footguns, and also reliability ones.

3. Remote work is very very common for IT people.

4. Recovery from configuration mess-ups is harder if your control plane has to run on the same network that you've messed up.

There are on-site controllers available. They've just lost out in the market because of the amount of in-house IT expertise they require. No one wants to deal with that shit, and outsourcing the security and reliability problems to a specialized third party is usually a good idea.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Silhouette on Tuesday March 30, 2021 @09:11PM (#26642463)
This looks like an enterprise perspective. For smaller organisations operating on a single site, some of these concerns won't apply. I also think you're being a little one-sided there because cloud-hosted configuration has its own risks in terms of security and accidentally cutting off your management access, many of them directly analogous to the ones you mentioned, plus you have all the usual concerns about any critical system that depends on Internet connectivity to work properly. At the end of the day, nothing is more reliable than local wired networking, and nothing is more flexible for disaster recovery than having someone physically on-site.

In the prosumer to small business segment, I would argue that there is still enormous potential value in being able to configure all of the network gear from a single GUI, not least because it doesn't then require a lot of in-house networking expertise to get something going that works and is reasonably secure.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @09:49PM (#26642680)
> also think you're being a little one-sided there because cloud-hosted configuration has its own risks in terms of security and accidentally cutting off your management access, many of them directly analogous to the ones you mentioned,

But with a cloud-managed system you have a professional, single-purpose organization dealing with those challenges. Which you are getting for the rock-bottom price of your licensing/support plan. Building a good internal IT organization is hard and expensive, and most businesses have other things to do.

> plus you have all the usual concerns about any critical system that depends on Internet connectivity to work properly.

Generally these systems only need internet connectivity to change the configuration and for some monitoring features. In practice, customers are okay with these being unavailable during internet outages as long as both the management platform and the ISP are on a pretty strict SLA.

(Compare, for example, the usual downtime from your 1-4-person IT team not having someone with the right skills on call.)

> and nothing is more flexible for disaster recovery than having someone physically on-site.

Who has the cash for that?

> In the prosumer to small business segment, I would argue that there is still enormous potential value in being able to configure all of the network gear from a single GUI, not least because it doesn't then require a lot of in-house networking expertise to get something going that works and is reasonably secure.

That was my original point: "Generally, halfway decent wireless APs are all targeted at the enterprise market. Consumer hardware is a brutal race to the bottom, as lay consumers aren't qualified to compare options based on anything but price and UI. Ubiquiti was an outlier in trying to bring enterprise features to the consumer market"

I don't know what your standard for a 10-to-50-employee small business is, but "point your browser at this IP address" is usually beyond their in-house technical skills [1]. Small businesses whose core competence is software/networking, or who by coincidence have that expertise in-house, are a tiny niche market. No one [2] cares.

[1] See for example the rise of the Managed Service Provider, which was a large and growing subsegment for Meraki back in 2015 or so. Showing up, installing the hardware, setting up the wireless, and then managing it from your office a few miles away is a big business opportunity, and is a much more efficient use of limited skilled IT labor.

[2] No one with substantial resources and a profit motive.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Silhouette on Wednesday March 31, 2021 @12:13AM (#26643443)
OK, with tongue firmly in cheek, I will try to reply to your points from the perspective of the small organisations I was talking about.

But with a cloud-managed system you have a professional, single-purpose organization dealing with those challenges.

Just to be clear, are you thinking of the professional, single-purpose organization we've been discussing today in the context of a catastrophic data breach, the one we've been discussing in the context of incompatibilities with other vendors, lock-in effects and expensive licensing, or a different one?

Generally these systems only need internet connectivity to change the configuration and for some monitoring features

So as long as the equipment is set up exactly how we need it and never needs to change or be checked for any reason, everything is good. It's hard to imagine why these devices need a UI at all, when the engineer who installs the equipment could just set it up once and then you're done.

In practice, customers are okay with these being unavailable during internet outages as long as both the management platform and the ISP are on a pretty strict SLA.

John: Bob, the Internet is out again. Who do I call at the ISP?

Bob: We don't have a dedicated contact, it's just the business support number on their website.

John: I'm in the queue, at number 17. What's our maximum time for someone from the ISP to contact us about an outage? That might be faster.

Bob: No-one will call, but if it's not back by next business day we do get £50 off next month's bill.

(This is roughly how that conversation probably goes when you're a 20-person organisation with two floor of an office building on a business park outside a small town.)

(Compare, for example, the usual downtime from your 1-4-person IT team not having someone with the right skills on call.)

What's an IT team?

Who has the cash for that?

What cash? When we have a new starter, John or Bob sets up the WiFi on their laptop and company phone and adds those MAC addresses to the whitelist for the network. Normally John works in development and Bob works in sales, but they do know a bit about networks so this is fine. Well, as long as they can get to the GUI, anyway.

Small businesses whose core competence is software/networking, or who by coincidence have that expertise in-house, are a tiny niche market. No one [2] cares.

And yet as someone who has worked for software development businesses for an entire career and whose customers/clients have mostly been other relatively small organisations of one type or another, I have never met one that didn't. Of course that could be because I've tended to work with other technically-inclined businesses, but the same is true even for schools or my own business's accountants. I'm not claiming this is some sort of universal truth, but I don't think the market is nearly as tiny as you're suggesting, at least not in this part of the world (the UK).

Remember, we're probably not talking about setting up encrypted WAN tunnels across continents and multiple layers of switches in a data centre here. We're more likely to be talking about getting an Internet connection with suitable firewall set up, connecting a handful of switches and APs and making sure everyone knows the WiFi password, and installing everyday software on the staff PCs and mobile devices with maybe some basic configuration and enabling updates.

[1] See for example the rise of the Managed Service Provider, which was a large and growing subsegment for Meraki back in 2015 or so. Showing up, installing the hardware, setting up the wireless, and then managing it from your office a few miles away is a big business opportunity, and is a much more efficient use of limited skilled IT labor.

They're not unheard-of here, but again, in my experience such arrangements are far less common in smaller organisations than just having a couple of people on the staff who also "set up the IT" and know enough for the kinds of everyday admin tasks you're talking about.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Wednesday March 31, 2021 @12:59AM (#26643690)
> What cash? When we have a new starter, John or Bob sets up the WiFi on their laptop and company phone and adds those MAC addresses to the whitelist for the network. Normally John works in development and Bob works in sales, but they do know a bit about networks so this is fine. Well, as long as they can get to the GUI, anyway.

"Small businesses whose core competence is software/networking, or who by coincidence have that expertise in-house, are a tiny niche market."

You have that expertise in house. Having looked at sales numbers and market research for a company that sold internationally and cross-industry: yes, your experience is very unrepresentative.

> even for schools...

Tangent: schools are honestly pretty technically sophisticated! We sold to some of them at Meraki, but they were drawn to us more for labor savings than to compensate for limited expertise. Education customers typically had very few (especially in perpetually-underfunded US primary and secondary schools), but very competent, IT people. They were feature-hungry power users.

In part that's because, even with low employee headcount, they have to provide a surprising level of IT services per student as well. A school with 80 employees and 1000 students probably has the IT workload of a white-collar employer with 500+ headcount.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Silhouette on Wednesday March 31, 2021 @02:09AM (#26644017)
You have that expertise in house. Having looked at sales numbers and market research for a company that sold internationally and cross-industry: yes, your experience is very unrepresentative.

OK, let's assume that's true for the sake of discussion. According to your market research and sales numbers, what is the big market for these cloud-managed products among smaller organisations, and how do those organisations generally manage their IT facilities?

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Wednesday March 31, 2021 @03:39AM (#26644481)
Generally, they either:

1. Use low-cost consumer hardware with zero centralized management, and set it up with the same expertise and judgment as your typical residential deployment.

2. Have one admin person with the wherewithal work with web UIs, and wants a simple setup-and-forget system. UI not much more complicated than a single-AP residential deployment, user management workflow no more complicated than adding a G-Suite user. If they can use the default password for the admin system, they will (which e.g. Meraki and Aruba don't have in any meaningful sense).

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Silhouette on Wednesday March 31, 2021 @05:33AM (#26645187)
OK, so let's look at the second of those, since the first is consumer level and not really our target market for professional grade networking equipment.

Your original contention was that it's hard to implement a single pane UI without putting a bunch of logic in the cloud. If our hypothetical one admin person with some idea of what they're doing, together with any automatic assistance the relevant devices provide, can set up enough local networking that all of those devices can reliably access the Internet and support cloud-based configuration, then a similar process can set up those devices to support single pane configuration using the LAN only.

At that point, looking back to the four "hard problems" you enumerated a few comments ago, I still don't see a strong argument for needing the cloud dependency.

The risks around network setup and reliability don't seem any worse for LAN-based configuration than cloud-based. In fact, LAN-based clearly has an advantage by not relying on any external infrastructure. It also has the advantage that if you want to get more serious for a larger deployment, you can run independent cabling and create a dedicated management network for control signalling, while most places aren't going to have an independent second Internet connection for management traffic if you accidentally break your configuration so your main data network loses Internet access.

Managing multiple sites is probably a non-issue at this level of the market.

Remote access for IT/support people is easily provided if necessary by having safe and easy VPN setup as part of your user-friendly interface. This has the added advantage that your tech people can also reach any other parts of the network they need, and so you might have required this functionality anyway. And if it's locally configured, you can always quickly shut that VPN access off again in case of any security worries, without needing anyone else's remote systems to be working properly before you can secure your own in an emergency.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by kortilla on Tuesday March 30, 2021 @09:46PM (#26642662)
> 4. Recovery from configuration mess-ups is harder if your control plane has to run on the same network that you've messed up.

That’s a senseless statement in the context of a cloud solution that requires Internet to work.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @09:54PM (#26642717)
In actual deployments and support situations I saw at Meraki, connectivity from individual hosts to the internet was usually the most reliable part of the network.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Silhouette on Tuesday March 30, 2021 @07:06PM (#26641642)
At this point, it feels like the reasons to use or not use Cisco for networking are much the same as the reasons to use or not use Oracle for databases. I'm not sure it has much to do with the technology in either case any more.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by admax88q on Tuesday March 30, 2021 @08:51PM (#26642341)
> Note, however, that roaming between APs is a feature of the 802.11 standard;

In theory yes, but man do a lot of devices have terrible roaming heuristics.

"I can still see beacons so id better stay here even though i havent received a packet in the last minute. Wouldnt want to pay the time cost of associating with that other BSS that has 5X the signal"

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by londons_explore on Tuesday March 30, 2021 @10:48PM (#26643001)
The key issue is the protocol seems to have no ability to associate with multiple BSS's together.

It's so nearly there. The power management stuff means that even with single a physical radio one can associate with multiple BSS's on different frequencies by telling one BSS to hold packets for you while tuning in to the other frequency.

All that's needed to make it reality is a way to tell a BSS "If I fail to ACK a link layer packet, please forward it via the wired network to this other BSS to send to me instead".

Then a client could be connected to multiple BSS's, send packets via either, receive packets via whichever one it is currently tuned into, and not lose any packets while switching.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by jhugo on Tuesday March 30, 2021 @09:16PM (#26642489)
You can fix this on the AP side with minimum RSSI or data rate control. But that would probably push you over to either Ubiquiti (and the similar “cloud based” options) or the enterprise market to get those features, unfortunately.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by KozmoNau7 on Wednesday March 31, 2021 @04:31AM (#26644791)
On Mikrotik you can set the minimum allowed data rate, at least. That should kick clients with marginal connections to a hopefully better AP.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by labawi on Wednesday March 31, 2021 @05:19AM (#26645085)
Have you tried setting your transmit power low (just enough to get good signal to the places intended, but definitely no more than your devices can trasmit) and increasing the minimum send rate to something reasonable (say 10-40 Mbps, beacons use minimum rate)?

It should help high power bad signal (some devices use fixed thresholds) and equalize the beacon vs. data reception quality.

I don't think openwrt had data rate config in webui, but it does support the setting in the config files (that I normally scp onto a device). The following seems to work:

  /etc/config/wireless:
  config wifi-device 'radio0'
    ...
    option txpower '1'      << 1mW (more than enough for 1 room)
    option legacy_rates '0'
    list basic_rate '24000 36000 48000 54000'
    list supported_rates '24000 36000 48000 54000'
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by PakG1 on Wednesday March 31, 2021 @10:22PM (#26655948)
This messes with your AP placements though. Depending on your AP placements, you may or may end up with deadspots. You need to be sure that your AP placement is sufficient when taking this strategy. And yes, I take this strategy too.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by hansel_der on Thursday April 01, 2021 @04:09AM (#26657821)
> In theory yes, but man do a lot of devices have terrible roaming heuristics.

i hear this a lot but never experienced it myself, maybe related to outdated os?

been running multi-ap with same ssid/key no special sauce for years and it just works.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by l33tman on Wednesday March 31, 2021 @04:32AM (#26644807)
I went through this when setting up wlan in a new office some years ago, looked at roaming APs etc.. finally I just bought 4 consumer Asus routers on the same SSID, worked fine for all our purposes at least.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by AndyMcConachie on Wednesday March 31, 2021 @03:52AM (#26644546)
Do people _really_ need wifi roaming in their homes?

I have multiple cheap APs setup in my house using the same SSID and it's fine. As long as I'm not holding a realtime conversation and moving around between APs I never have any problems. And since I almost never hold a Skype call while walking through my house I almost never have any issues.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Arnt on Wednesday March 31, 2021 @05:49AM (#26645279)
You don't have stone walls. And you haven't spent the last year working in a study that's located between two APs, where clients flip now and again and Zoom would tear down the connection.

Of course you could say: Does the house have to be designed that way? Do the APs have to be located where they are, is it really necessary to have that stone wall, is it necessary to put the study in the place where it is, is it necessary to have that noise insulation around the elevator? None of that is necessary, but some Mikrotik hardware was much cheaper than getting rid of a stone wall and more pleasant than having to hear it when the neighbours use the elevators.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by cheschire on Wednesday March 31, 2021 @04:25AM (#26644760)
If you've ever lived in a country where the houses are made primarily of stone, you'd definitely understand the need for it.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by robotmay on Wednesday March 31, 2021 @04:40AM (#26644860)
Yeah I have a 2' thick stone wall in the centre of my house (old exterior wall). I have an AP on either side of it as they penetrate the ceilings/floors above fine, but nothing is getting through that wall and maintaing good signal.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by wcfields on Wednesday March 31, 2021 @10:03AM (#26647440)
A 1920's stucco bungalow with chicken-wire in the walls pretty much acts like a faraday cage in every single room.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by kalleboo on Wednesday March 31, 2021 @08:26AM (#26646311)
Or earthquake-proof reinforced concrete.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by regularfry on Wednesday March 31, 2021 @03:52PM (#26652222)
Just brick that's old enough will do it. Mine's something like 150 years old, and it's absolute murder to drill into, just incredibly hard, and it's either dense enough to act like stone, or it's absorbed enough moisture over the years to look like a faraday cage to wifi.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by theshrike79 on Wednesday March 31, 2021 @06:17AM (#26645467)
Yep, stupid L-shaped house where the inner curve is a damn Faraday Cage. NOTHING goes through.

If I'm in the living room and need to move to the other end of the house to get away from family-related noise, the device needs to roam between two APs.

Unifi handles this without any issues.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by waheoo on Wednesday March 31, 2021 @03:57AM (#26644581)
It's not about walking and talking, it's about sticky associations.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by oceanplexian on Wednesday March 31, 2021 @12:58PM (#26649760)
Even if you don't "need" roaming having more coverage lets you dial down the power on all of your APs, so you can get much closer to the theoretical maximum throughput.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by regularfry on Wednesday March 31, 2021 @03:49PM (#26652190)
4 floors, 150-year-old brick, random steel girders in annoying places, and a broadband line that comes into the building at almost the least convenient place possible. Yeah, I need roaming.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by martyvis on Wednesday March 31, 2021 @06:09AM (#26645416)
Also as long as you don't have big bags of attenuating water (people) moving between you and your AP you also funny need roaming.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by sly010 on Wednesday March 31, 2021 @08:08AM (#26646152)
> Note, however, that roaming between APs is a feature of the 802.11 standard; you just need to have all your APs on the same layer 2 (802.x) network, and using the same SSID and credentials. No fancy hardware required, and you can even mix and match vendors.

Not exactly. There are extensions to pre-authenticate with an AP (802.11r) for truly seamless roaming without packet drop or delay and for AP controlled roaming (802.11k) where the current AP tells you your options to roam to. This last one is important because the AP has generally better information about the network than the client and because the clients are not that great at managing this.

I am sure there are other extensions too, but afaik cheap APs don't implement these.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Wednesday March 31, 2021 @10:54PM (#26656128)
Depends on your definition of "seamless".

The base standard's behavior requires a reassociation to the new cell (i.e. AP i.e. BSSID). This introduces a gap in coverage, but for simple setups like the 5-AP one IgorPortola is talking - I assumed that this was using shared-password auth - the gap's length is functionally 0. 802.11r gets rid of that gap, which is important when using heavier-weight authentication protocols like 802.1x.

(Note that by 802.x in my original I meant not 802.1x, but rather the set of standards including 802.3 (ethernet) and 802.11 (wifi))

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by judge2020 on Tuesday March 30, 2021 @06:30PM (#26641371)
> having a trustworthy and secured backend.

Ubiquiti had a secured backend - their screw-up was not doing MFA on their admin accounts. I would still like if there was an option for a local-only control panel.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @07:09PM (#26641668)
If admin login is using weak credentials, it is by definition not a secure backend. Password/credential management and mandatory MFA are ALWAYS part of security due diligence for suppliers.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by uniformlyrandom on Tuesday March 30, 2021 @08:49PM (#26642330)
Except if it is awscli creds, then of course there is no MFA.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by LilBytes on Tuesday March 30, 2021 @09:04PM (#26642420)
This has been a concern for me for a while, but it's possible to use aws cli with mfa by throwing an IdP in front of it.

The work flow we used was AWS Vault -> Okta -> short lived AWS creds.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by LgWoodenBadger on Tuesday March 30, 2021 @09:02PM (#26642408)
What do you mean? Awscli supports key tokens from your 2fa device if your access keys are configured to require it
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by StreamBright on Wednesday March 31, 2021 @04:11AM (#26644676)
There are way to limit the scope of those. One set of credentials per environment for example. You can also limit the use of the these credentials by policy.

https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_p...

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Quiark on Tuesday March 30, 2021 @09:39PM (#26642619)
Exactly, no workflow for terraform or CLI if you have U2F (Yubikey) 2FA.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by BillinghamJ on Wednesday March 31, 2021 @04:21AM (#26644737)
That's not true. You can use AWS SSO with the CLI/SDKs (therefore including stuff like Terraform) with webauthn.

It briefly pops you out to a browser to authenticate and caches a short lived token locally

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by darkr on Wednesday March 31, 2021 @02:53AM (#26644231)
If you use federated auth, then you can do whatever you want; 10 UDF keys and a video of a special dance if you so desire
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by nijave on Wednesday March 31, 2021 @09:53PM (#26655786)
There's AssumeRoleWithSAML so you can use any IdP

There's tools like aws-okta that can advantage of that to supply short lived credentials which require 2FA

You could also write a service that requires whatever authentication you want and returns the results of STS AssumeRole

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Hnrobert42 on Tuesday March 30, 2021 @11:59PM (#26643368)
I really want to like U2F, but it’s use cases seem so limited.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by Nextgrid on Wednesday March 31, 2021 @06:24AM (#26645506)
AWS STS solves this problem.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by red_phone on Tuesday March 30, 2021 @06:53PM (#26641527)
For their UniFi line, at least, you don't have to use their cloud controller. You can self-host.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by MobileVet on Tuesday March 30, 2021 @08:00PM (#26642028)
Yep, I have my controller running on a Synology 720+ NAS that has zero ‘wide area network’ access. Everything is local to my home.

I am deeply saddened by Ubiquiti’s fall from grace... they were so good.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by DividableMiddle on Tuesday March 30, 2021 @08:55PM (#26642367)
Can you go into more detail about your setup? I have 920+ and am in the market for a new router (controller? Still learning the terminology).
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by hedora on Tuesday March 30, 2021 @10:17PM (#26642837)
The cloud controller is a (surprisingly heavyweight) service that manages a network of unifi devices. It can run on a raspberry pi, or an x86 container / vm.

If I wanted to run it all the time, I’d try putting it in a docker container on my synology.

Instead, I have an sd card for my raspberry pi that has nothing but the controller installed. The main downsides to this are that it is easy to lose the sd card, and that the controller gathers bandwidth/usage/wifi connection reliability stats, but only when it is running. I don’t get those unless I boot up the RPi to diagnose some network issue (this has never been an issue in practice).

One advantage of the RPi setup over a synology container is that it has both a ethernet jack and a wifi adaptor. This is surprisingly helpful when bootstrapping complicated mesh topologies.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by MobileVet on Tuesday March 30, 2021 @10:29PM (#26642910)
Yep, I put it in a Docker container on the Synology. Fairly straight forward. I followed a guide like this:

https://lazyadmin.nl/home-network/unifi-controller-on-a-syno...

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by katbyte on Tuesday March 30, 2021 @11:15PM (#26643134)
I have a UDMpro which self-hosts a controller, thou personally if i knew it couldn't be joined to another controller i'd have gotten something else so i could throw it in docker (which runs on a NUC with the storage off a synology)
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by asix66 on Tuesday March 30, 2021 @10:14PM (#26642806)
Yes. I run the controller on a raspberry pi 4. Local only.

I too am disappointed in UniFi’s direction.

I used to recommend them. I don’t now.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by katbyte on Tuesday March 30, 2021 @11:09PM (#26643107)
What do you use/recommend now?
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by asix66 on Wednesday March 31, 2021 @02:45PM (#26651305)
Gosh. I wish I knew. This thread is rife with alternatives, so other's guess is as good as mine. The unifi wifis I have running are still good and work extremely well. So my suggestion is to keep using them, but only if you host the controller software on your own hardware (I'm using RPi 4 as stated) and only if you avoid their cloud solution(s). (This IMO).

I am still looking for alternatives when the time comes to replace mine. Which I'll be forced to replace once/if they completely nerf the self hosted on self hardware options.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by lostlogin on Tuesday March 30, 2021 @07:49PM (#26641970)
Is that true on the UDM-Pro?

I couldn’t see an option on setup.

I might try block it from internet and see what happens.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by notwedtm on Tuesday March 30, 2021 @08:22PM (#26642150)
Yes, this is true. You can access the Unifi controller on the local internal IP.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by cle on Tuesday March 30, 2021 @07:33PM (#26641854)
This is what I do. I host a controller in AWS on an EC2 instance in my account. It works great.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by dijit on Tuesday March 30, 2021 @07:52PM (#26641987)
Out of interest, why wouldn't you host it on something like a raspberry pi?

Having your local network depend on an external network makes my old school sysadmin bones tingle for some reason.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by gregmac on Tuesday March 30, 2021 @08:46PM (#26642309)
The Ubiquiti controller is not needed for general operation, unless you're using a guest hotspot. Otherwise if it's offline you just lose ability to do configuration and it's data/stats logging.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by julianz on Tuesday March 30, 2021 @08:57PM (#26642376)
It's also needed if you want to have any control over SSID's such as enabling/disabling on a schedule, bandwidth limiting and so on.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by thrixton on Wednesday March 31, 2021 @12:34AM (#26643556)
Hah, that's a dream world where enabling/disabling SSID's ever worked properly.

They have a good UI, good hardware but the software seems half baked.

Originally with the switch to the "new settings", the schedules were switched between the AP's and the UDM, not sure about a dedicated cloud controller.

Great product, poor QA I think.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by cle on Tuesday March 30, 2021 @11:56PM (#26643357)
Laziness? I can just set it up with a couple of clicks and pay almost nothing (it runs on a t2).
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by nijave on Wednesday March 31, 2021 @09:49PM (#26655755)
Still lots of pitfalls with just MFA. Text/email being the worst and TOTP being somewhat better but not great. A lot of password vaults support storing the TOTP secret so they can generate time based codes which seems reasonable when the vault is 2-3 factor protected (some do IP heuristics, passwords, tokens, PINs, etc). Unfortunately if someone gets access to the vault in it's unencrypted state you're in for a world of hurt.

From a couple years back, https://arstechnica.com/information-technology/2016/04/how-h... (the hackers got remote access to a sysadmins desktop then waited til he mounted TrueCrypt and stole the entire contents)

Even with hardware tokens, if someone gets access to your machine while you're using it they can wait til you authenticate then use the creds proxying requests through your machine so they look legit

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by krageon on Wednesday March 31, 2021 @04:32AM (#26644804)
> their screw-up was not doing MFA

So you're saying it was both not trustworthy and not adequately secured?

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by StreamBright on Wednesday March 31, 2021 @04:08AM (#26644657)
I never onboard anybody without MFA. Turning it off is a firing offense.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by katbyte on Tuesday March 30, 2021 @11:12PM (#26643115)
I run a local controller with no remote access for unifi - i would never use any networking hardware that needed a cloud controller/connection for breaches exactly like this.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by cyberlab on Wednesday March 31, 2021 @09:14AM (#26646832)
> their screw-up was not doing MFA on their admin accounts

MFA is not a silver bullet. You can still login with stolen cookies and 'replay' the session without signing in.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by turfyman on Thursday April 01, 2021 @08:39AM (#26659708)
Same here. I don’t need remote access to manage my network. I work from home and spend a majority of my time there.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by emmelaich on Tuesday March 30, 2021 @10:47PM (#26642991)
Worth noting that Meraki have a small business option now: https://www.meraki-go.com/
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by thiagocsf on Wednesday March 31, 2021 @06:45AM (#26645620)
Says “cloud managed” on every piece of equipment. Do you know if that’s optional?
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by emmelaich on Thursday April 01, 2021 @01:29PM (#26663592)
Not optional on any Meraki gear afaik.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by tumblewit on Wednesday March 31, 2021 @03:00AM (#26644281)
Wow this is great and seems like a direct competitor to UniFi. Few years back when I was researching meraki I found it way too pricey for small business over UniFi but this makes much more sense now.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by fullstop on Tuesday March 30, 2021 @05:53PM (#26641053)
Surely 802.11r has a purpose, yes?
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @07:18PM (#26641734)
It's a performance thing.

With standard 802.11 roaming, you have to reassociate and reauthenticate to the new AP. While this process is underway, you can't pass any traffic. For open networks or simple auth schemes like WPA2 single-password, this isn't very noticeable; however, for heavier-weight auth schemes like 802.1x this pause is substantial and is especially noticeable on voice/video calls. 802.11r is a scheme for caching the authentication info, letting you avoid the 802.1x round-trip to a central auth server.

For a 5-AP network, usually with shared-password WPA2, it's not necessary.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by cassianoleal on Tuesday March 30, 2021 @06:20PM (#26641290)
Yes, roaming by sharing SSID and passcode is a world of pain. 802.11r solves all those pains, I've been using it on OpenWRT for months without a glitch.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by fullstop on Wednesday March 31, 2021 @11:34AM (#26648592)
Yes, it's why I use 802.11r. It works with most devices, although the one which does not support it makes me laugh. Nintendo Switch will not switch from one AP to another. It holds on, tooth and nail, to whichever BSSID it used when it first connected.

My kids have to go into settings, reconnect, and move on.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by tmottabr on Monday April 05, 2021 @08:39AM (#26698194)
afaik that is a design decision by nintendo.

i think it did support roaming in the past and they disabled it in an OS update.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by slmkbh on Wednesday March 31, 2021 @06:31AM (#26645543)
I have a couple of AP AC Lites running openwrt and 802.11r, works fine except on Xiaomi phones apparently... I never tried the unifi though, flashed openwrt within 15 minutes of receiving the APs
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by synergy20 on Tuesday March 30, 2021 @07:37PM (#26641885)
how do you enable 802.11r on openwrt? on which model of router
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by mikehotel on Tuesday March 30, 2021 @08:16PM (#26642121)
Install the wpad pkg and 802.11r should show up in wireless config screens. See https://forum.openwrt.org/t/802-11r-fast-roaming-in-luci/117...
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by cassianoleal on Wednesday March 31, 2021 @06:51AM (#26645659)
Pretty much that. It's also very simple nowadays. you just tick the box on the Wireless Security tab, and check that the mobility domain match between all the APs - it should by default, I think it's derived from the SSID.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by kelnos on Wednesday March 31, 2021 @12:49AM (#26643635)
Be aware that there might be compatibility issues. I enabled it on a pair of OpenWRT-running APs, and the handoff worked fine for my laptop, but my phone would claim to be successfully associated/authenticated with the new AP, but traffic wouldn't flow. Turning off 802.11r fixed the issue completely, and it turns out I don't really need it after all, as my devices seem to roam properly and the reauth is pretty quick.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by betterunix2 on Tuesday March 30, 2021 @05:57PM (#26641094)
Faster handoffs between APs.
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by passivate on Tuesday March 30, 2021 @06:58PM (#26641568)
We use Meraki MR/MX stuff at our office and are generally happy with the value & service. The MS stuff though, thats another story. Do you guys have plans to enter the sub $2K tier with L3 devices?
Re:Whistleblower: Ubiquiti Breach “Catastrophic” by azernik on Tuesday March 30, 2021 @07:13PM (#26641690)
I haven't worked at Meraki since 2015; sorry, can't help you out on that one.

I will note that as of 2015, "L3 switching" (i.e. hardware-accelerated IP routing) hardware was expensive as hell. I believe that on the software side, dropping new hardware into the existing hardware-routing infrasturcture is fairly easy, but I don't actually know because I didn't work much on MS hardware.

Re:Whistleblower: Ubiquiti Breach “Catastrophic” by StreamBright on Wednesday March 31, 2021 @04:06AM (#26644646)
I still remember the first Meraki device. It was so good. I used it a lot.