Re:Former Tesla Firmware Engineer Discusses the System
by jtwaleson on Friday August 24, 2018 @03:16PM
(#17837189)
248 days of uptime by any chance?
edit: I saw the same on a fleet of thousands of JVMs which hung on 100% CPU after 248 days very consistently. Closest thing to an explanation I ever got was perhaps it is storing uptime in hundredths of a second (why not ms???) in signed 32 bit integers, see: https://ma.ttias.be/248-days/ In the end we solved it by restarting with a cronjob between 2am and 4am after 247 days...
Re:Former Tesla Firmware Engineer Discusses the System
by LinuxBender on Friday August 24, 2018 @04:34PM
(#17837708)
One thing to look at is the sum of Anonpages if you have THP enabled. That was enabled by default after CentOS6.2. The usage itself isn't an issue, but there is a known memory leak in THP and the fragmentation can get wedged after a couple hundred days based on usage characteristics of the server.
Re:Former Tesla Firmware Engineer Discusses the System
by SEJeff on Friday August 24, 2018 @05:46PM
(#17838082)
Million? For linux perhaps billion :)
Re:Former Tesla Firmware Engineer Discusses the System
by blub on Friday August 24, 2018 @03:21PM
(#17837232)
Ubuntu Linux has millions of testers, your custom version has only been tested by you and your customers :)
At least with Linux you're getting a system that's been used so much that all major issues like that are ironed out. Nothing beats a few million testers.