News for hackers. Stuff that matters.
Re:Kafka Removing Zookeeper Dependency by vips7L on Saturday May 16, 2020 @10:47PM (#23209076)
There's nothing to figure out. If you want to use all your ram (like in go) just set -Xmx<all_your_ram>.
Re:Kafka Removing Zookeeper Dependency by simtel20 on Sunday May 17, 2020 @12:40AM (#23209630)
If you haven't done -Xmx=<all memory> before, you may not be aware that you're giving a bum steer here.
Re:Kafka Removing Zookeeper Dependency by bobbyi_settv on Sunday May 17, 2020 @02:16AM (#23209978)
But to know whether you want that, you need to understand the application. Elasticsearch, for example, recommends using at most 50% of physical memory for heap:

https://www.elastic.co/guide/en/elasticsearch/reference/curr...

You also often want to stay below 32 gb to get compressed OOPs

Re:Kafka Removing Zookeeper Dependency by thayne on Sunday May 17, 2020 @01:35AM (#23209816)
That is a terrible idea. The JVM basically never returns RAM to the OS, and in my experience, if you run a java process long enough, the max heap size ends up being the used heap size.
Re:Kafka Removing Zookeeper Dependency by vips7L on Sunday May 17, 2020 @02:46AM (#23210114)
G1 the default allocator returns heap to the os only when you set -G1PeriodicGCInterval and both ZGC and Shenandoah do it automatically.
Re:Kafka Removing Zookeeper Dependency by tbrock on Sunday May 17, 2020 @07:29AM (#23211254)
Why isn’t that the default? Unless I say otherwise, use it.

Imagine launching every app and having to say ok you get 300mb but not more!

Re:Kafka Removing Zookeeper Dependency by rahilb on Sunday May 17, 2020 @08:06AM (#23211408)
It’s the default because Java has a history, and it was set when everyone was deploying war files to machines with 512mb total memory and the default worked for 95% of people for the past 25 years. In fact, it’s still good enough for the chocolate factory that has brainwashed you into drinking the static binary milkshake.

Of course there are ways to use all the available ram when you deploy your kubernetes pods, you just have to consult the documentation.

Honestly this criticism is ridiculous I can’t believe I even bothered to reply.