Re:Ask HN: What do you monitor on your servers?
by hinkley on Saturday August 17, 2024 @06:46PM
(#41278640)
I need to find a really good intro to queuing theory to send people to. A full queue is a slow queue. You actually want to aim for about 65% utilization.
Re:Ask HN: What do you monitor on your servers?
by bayindirh on Saturday August 17, 2024 @06:50PM
(#41278663)
Also, there was a formula for determining the optimal cache size. I forget the name all the time. IIRC, in the end, caching most popular 10 items was enough to respond to 95% of your queries without hitting the disk.
Re:Ask HN: What do you monitor on your servers?
by redxtech on Saturday August 17, 2024 @11:48PM
(#41280001)
If the numbers from the phoenix project are to be trusted, a loose estimate is the time spent in queue is proportional to the ratio of utilized to unutilized resources. For example, 50% used & 50% unused is 50:50 = 1 unit of time. 99% used is 99:1 = 99 units of time.
Re:Ask HN: What do you monitor on your servers?
by Version467 on Sunday August 18, 2024 @12:40AM
(#41280168)
This might be too basic, but I found this blog post to be an incredible introduction to queues: https://encore.dev/blog/queueing
Look, we're using just 50% of that RAM. Look, there're two cores that are almost idle.
No & No. Rest of the RAM is your secret for instant responses, and that spare CPU resource is for me to do system management without you notice or to front the odd torrent of requests we have semi regularly (e.g.: /. hug of death. Remember?).