News for hackers. Stuff that matters.
Re:250M Microsoft customer service and support records expos... by Spooky23 on Wednesday January 22, 2020 @01:37PM (#22120528)
What is it about elastisearch that dopey people stuff them with information and leave them on the open internet, all of the time?
Re:250M Microsoft customer service and support records expos... by farisjarrah on Wednesday January 22, 2020 @02:21PM (#22121003)
Elasticsearch started life as a free product and security was a paid addon to that product via the X-Pack, now Elastic Co has made the security stuff free but people still don't implement it. Elasticsearch is insecure out of the box and it takes extra steps to get it secured, and most people don't do those steps even though its pretty well documented right here:

https://www.elastic.co/guide/en/elasticsearch/reference/curr...

Re:250M Microsoft customer service and support records expos... by blinkingled on Wednesday January 22, 2020 @02:45PM (#22121238)
Security features in Elastic still require paid subscription. The link you pasted even says that. You can use the xpack features for free on a trial basis but for production use you're required to buy a license.
Re:250M Microsoft customer service and support records expos... by jturpin on Wednesday January 22, 2020 @03:04PM (#22121438)
This is not true, you can use some xpack security features such as basic auth, client TLS and node-to-node TLS for free. We use basic auth (with Vault integration) at my company using just the basic license. https://www.elastic.co/subscriptions has details on the subscription levels.
Re:250M Microsoft customer service and support records expos... by blinkingled on Wednesday January 22, 2020 @07:05PM (#22123448)
Thanks, I did not know about basic license. Although if you wanted to use OSS license my point still stands. (Not sure what restrictions the basic license brings so for some the only option might be the OSS license.)
Re:250M Microsoft customer service and support records expos... by jturpin on Wednesday January 22, 2020 @07:13PM (#22123504)
You're right, and it is only recently that this stuff became free anyways, sometime last year. I think Amazon's OpenDistro stuff put some pressure on them. Even TLS was gated, which was the biggest offense in my opinion!
Re:250M Microsoft customer service and support records expos... by farisjarrah on Wednesday January 22, 2020 @02:51PM (#22121295)
Thank you for the correction. I thought I heard rumblings about their X Pack being free, but I had probably just heard about the trial.
Re:250M Microsoft customer service and support records expos... by blinkingled on Wednesday January 22, 2020 @02:56PM (#22121342)
You can use the Amazon OpenDistro provided plugins on top of oss ES to enable security features.
Re:250M Microsoft customer service and support records expos... by jacquesm on Wednesday January 22, 2020 @02:16PM (#22120958)
In a word: devops.

Developers are not operators and operators are not developers. The whole idea that we can do away with this specialization and and relegate operations to the people that create software because it is now possible to script infrastructure and to install complex packages with a few mouseclicks does not make it true. Operations and the complexity that goes with it is a job in its own right, no competent operator would have left this situation as it came out of the box.

Re:250M Microsoft customer service and support records expos... by AnIdiotOnTheNet on Wednesday January 22, 2020 @03:13PM (#22121522)
A combination of businesses' desire to spend less on labor and your average developer's inherent sense of superiority mean this trend is unlikely to go away any time soon though.
Re:250M Microsoft customer service and support records expos... by arpa on Wednesday January 22, 2020 @04:22PM (#22122187)
I believe you can be both competent operator and a reasonable developer at the same time. The skills complement each other nicely. It is a lot of work to be these things though.
Re:250M Microsoft customer service and support records expos... by Filligree on Wednesday January 22, 2020 @01:44PM (#22120588)
It's the default configuration. Unless you go out of your way to ensure security, you'll get this result.
Re:250M Microsoft customer service and support records expos... by thekyle on Wednesday January 22, 2020 @01:45PM (#22120604)
I believe Elasticsearch does not have authentication built into the open source version.
Re:250M Microsoft customer service and support records expos... by btown on Wednesday January 22, 2020 @01:51PM (#22120681)
This is no longer true, but ONLY as of May 2019 in response to pressure from the containerization world.

https://www.elastic.co/blog/security-for-elasticsearch-is-no...

It’s not default insecure like Mongo was - this was far far worse. You couldn’t even prototype in a secure way even if you wanted to, without a massive contract. One of the most frustrating things in software - IMO they deserved to have AWS commoditize their stack.

Re:250M Microsoft customer service and support records expos... by shawnz on Wednesday January 22, 2020 @02:20PM (#22121001)
The module is now free, but it's not open source, it is licensed under the proprietary Elastic license. The source is available but it is not licensed to be used with anything except the Elastic licensed version of Elasticsearch (not even the Apache licensed version of Elasticsearch)

However, Amazon has thankfully released a free and open source security module for Elasticsearch as part of their Open Distro project. It is based on another project called Search Guard. See: https://opendistro.github.io/

Re:250M Microsoft customer service and support records expos... by xvector on Wednesday January 22, 2020 @02:00PM (#22120779)
Perhaps it's a controversial opinion, but I feel like it's just flat out unethical to relegate basic security to the paid/enterprise version of your product.

Of course it's unethical to use said product to store real user data too, but the road goes both ways.

Re:250M Microsoft customer service and support records expos... by bouke on Wednesday January 22, 2020 @02:03PM (#22120804)
Just deploy it on your local network. No need to expose it to the internet. Sure, authentication is a nice bonus, but a simple firewall goes a long way.
Re:250M Microsoft customer service and support records expos... by jturpin on Wednesday January 22, 2020 @02:15PM (#22120930)
I don't get why it ever needs to be on the internet even when it does have authentication. Surely the public/private subnet split is a common practice.
Re:250M Microsoft customer service and support records expos... by CydeWeys on Wednesday January 22, 2020 @04:52PM (#22122443)
Unless the private subnet is airgapped from the Internet, it's not a good enough separation.

Hell, even if it is airgapped, it can still be compromised by viruses on USB sticks and such.

You should never be leaving sensitive systems wide open, period, regardless of how secure you might think that network is. Thousands of data breaches have been caused because networks didn't end up being as secure or as separated as hoped for.

Re:250M Microsoft customer service and support records expos... by kirstenbirgit on Wednesday January 22, 2020 @04:32PM (#22122280)
The way I see it, password auth for db servers is the last-resort protection mechanism.

If you get to the point where it’s what’s protecting your data, you’re already fundamentally screwed.

Re:250M Microsoft customer service and support records expos... by CydeWeys on Wednesday January 22, 2020 @04:53PM (#22122445)
You should definitely have it too, though.
Re:250M Microsoft customer service and support records expos... by CydeWeys on Wednesday January 22, 2020 @04:51PM (#22122424)
Defense in depth is important. Lots of data breaches have been caused because things that should have just been viewable from a local network, weren't, or the network was compromised. Unless you think every single employee is invulnerable to spear-phishing (which is impossible), you should never be leaving anything sensitive wide open on your local network.
Re:250M Microsoft customer service and support records expos... by fulafel on Wednesday January 22, 2020 @03:29PM (#22121665)
ES is very poorly engineered but unexplainably popular. The interesting question is why it's popular.
Re:250M Microsoft customer service and support records expos... by freeone3000 on Wednesday January 22, 2020 @04:12PM (#22122103)
Fast free full-text search over arbitrary documents. It solves a problem lots of people need.
Re:250M Microsoft customer service and support records expos... by fulafel on Thursday January 23, 2020 @02:56AM (#22125719)
Iirc it doesn't have very good support for document formats (eg pdf, office). It's also a huge resource hog so not particularly fast in the bang for the buck sense.
Re:250M Microsoft customer service and support records expos... by tristor on Wednesday January 22, 2020 @04:08PM (#22122060)
Honestly, some of the most preventable and dumbest outages and failures in my career have involved ElasticSearch. Most of the time it's deployed and managed by a dev team with no operational oversight, and therefore nobody to think about or catch these types of issues. It is compounded by the fact that all the security features in ES were paywalled for a very long time and most technologists don't understand basic networking anymore.

As many other answers to your query have stated, this is caused by a broken understanding of the devops methodology among organizational management forcing developers who are not competent in systems administration to be responsible for these systems.

Re:250M Microsoft customer service and support records expos... by monksy on Wednesday January 22, 2020 @02:06PM (#22120838)
We don't have sysadmins anymore "because of the cloud"
Re:250M Microsoft customer service and support records expos... by bcrosby95 on Wednesday January 22, 2020 @03:31PM (#22121685)
Equally important, we don't have network admins. It would be physically impossible to expose our search database like this to the open internet. Extra layers of protection are great.

It reminds me of companies I've worked with before that accidentally had a production site pointed to a dev database. Why the hell is that even physically possible with your network setup?

Re:250M Microsoft customer service and support records expos... by mdavidn on Wednesday January 22, 2020 @04:44PM (#22122381)
Amazon does provide a mechanism to define private networks disconnected from the internet.

https://aws.amazon.com/vpc/

Re:250M Microsoft customer service and support records expos... by mschuster91 on Wednesday January 22, 2020 @04:15PM (#22122118)
Welcome to the wonderful world of Kubernetes (or, for that matter, any Docker orchestration solution, such as DC/OS).

Anything can reach anything, provided you know the naming schema... and there's no easy way to fix it on anything that is not AWS/Azure/GCP, not without losing all the benefits of a self hosted k8s cluster in the first place.

Openstack at least provides ways to isolate machines, but that's VM-level only and truly an ultimate PITA to set up.

Re:250M Microsoft customer service and support records expos... by arpa on Wednesday January 22, 2020 @04:19PM (#22122165)
Not entirely true, there are network security policies (on select few CNI providers) and other means of segregation using good old iptables (although probably need to update alternatives for iptables to point to iptables-legacy for them to work).
Re:250M Microsoft customer service and support records expos... by mschuster91 on Wednesday January 22, 2020 @04:21PM (#22122183)
Ew. iptables (or any other way of messing around with the black magic that Docker and the orchestrators do to provide intra-container networking) is one thing only and that is a nice way to shoot yourself in the head while aiming at your legs.
Re:250M Microsoft customer service and support records expos... by arpa on Wednesday January 22, 2020 @04:34PM (#22122293)
To be entirely honest, if you know what you're doing and how lets say kube-proxy works in essence, things get pretty easy and simple. If you start every configuration of firewall with iptables -F, you're gonna have an interesting time. However, if you spend some time around these beasts, they are pretty well and logically built and it is trivial to coexist and modify your chains without touching those managed by docker/k8s. There is no black magic/and or wrong with the way they manage the rules. I'm much more angry at proper iptables being moved to iptables-legacy and systemd messing around with my resolv.conf :)
Re:250M Microsoft customer service and support records expos... by mbreedlove on Wednesday January 22, 2020 @02:47PM (#22121256)
"Sysadmins? No, we just have devops now!"
Re:250M Microsoft customer service and support records expos... by dvfjsdhgfv on Wednesday January 22, 2020 @02:59PM (#22121379)
Many managers use "devops" as an excuse to put a lot of burden on a small team, then this team is doing their best to automate managing a large number of machines but it's physically impossible to delve deeper into details and polish things, hence mishaps are bound to happen. And don't get me started on on what is happening inside containers.
Re:250M Microsoft customer service and support records expos... by tylfin on Wednesday January 22, 2020 @04:07PM (#22122048)
Sorry but I'd like to get you started on what is happening inside containers ;P

Specifically can you go into more details about what worries you with containers. Is it insecure images with out of date software, or risky applications inside the containers? Something else?

Re:250M Microsoft customer service and support records expos... by mschuster91 on Wednesday January 22, 2020 @04:17PM (#22122143)
Let's imagine your JIRA is insecure, someone owns it and obtains RCE, then does a privilege escalation on the host, whoops suddenly all services are accessible whereas that would have required more steps and owning in the old one-vm/bare metal-server-per-service model.
Re:250M Microsoft customer service and support records expos... by arpa on Wednesday January 22, 2020 @04:25PM (#22122226)
Escaping properly namespaced/pivot_root'ed environment and owning a host is non-trivial too.