News for hackers. Stuff that matters.
Re:Red Hat memory optimisations and Riak performance by jermo on Thursday April 23, 2015 @09:26AM (#9426475)
They're not the only ones running into issues with TPH and numa. For more suggestions to reduce jitter on Linux see Gil Tene's (Azul) advice: http://highscalability.com/blog/2015/4/8/the-black-magic-of-...

Namely:

  - Turn THP (Transparent Huge Pages) OFF.

  - Set vm.min_free_kbytes to AT LEAST 1GB (8GB on larger systems).  

  - Set Swappiness to 0.  

  - Set zone_reclaim_mode to 0.
[ Parent | on HN ]
Re:Red Hat memory optimisations and Riak performance by geidies on Thursday April 23, 2015 @10:32AM (#9426927)
Good advise - but a swappiness = 0 setting can bite you as well. See an explanation in http://www.chinanetcloud.com/blog/attack-of-the-killer-kerne... and why we set swappiness = 1.
[ Parent | on HN ]
Re:Red Hat memory optimisations and Riak performance by mitchell_h on Thursday April 23, 2015 @09:18AM (#9426432)
Has anyone actually run into a situation where THP is a benefit? I've run into enough memory slow downs by transparent huge pages that it's just a default to turn it off on all builds. I've never seen a production work load that has had any performance gain from THP.

Same with numa.

[ Parent | on HN ]
Re:Red Hat memory optimisations and Riak performance by feld on Thursday April 23, 2015 @01:27PM (#9428314)
Yes, someone has been working on upstreaming 1GB SuperPages to FreeBSD because it dramatically increased the performance of their firewall appliances.

https://lists.freebsd.org/pipermail/freebsd-hackers/2014-Nov...

These large (>4K) pages definitely have their uses.

[ Parent | on HN ]
Re:Red Hat memory optimisations and Riak performance by bonzini on Friday April 24, 2015 @07:15AM (#9432486)
THP was introduced for KVM, and has huge benefits there. In fact I suggest that you set /sys/kernel/mm/transparent_hugepage/enabled to "madvise" rather than "never". This was applications that like their hugepages can still enable it manually.
[ Parent | on HN ]
Re:Red Hat memory optimisations and Riak performance by kokey on Thursday April 23, 2015 @09:49AM (#9426611)
It is also interesting to see a company using elasticsearch and riak together. I have considered looking into that combination after having some grief with riak 2.0 with a bundled in Solr.
[ Parent | on HN ]