My £4 a month server can handle 4.2M requests a day

Re:My £4 a month server can handle 4.2M requests a day by xfitm3 on Tuesday September 07, 2021 @06:49PM (#28450832)

In my experience disk i/o is the biggest bottleneck. It used to be sync()ing writes to disk for strict consistency but that's been pushed down to the DB now. I just looked at my DB systems and CPU is low but disk is nearly pegged.

My data sets are far too big to fit into memory/cache. Disk pressure can be alleviated by optimizing queries but it's a game of whack-a-mole.

I have exhausted EBS i/o and been forced to resort to dirty tricks. With RDS you can just pay more but that only scales to a point – normally the budget.

[ Parent | on HN ]

Re:My £4 a month server can handle 4.2M requests a day by FridgeSeal on Tuesday September 07, 2021 @07:47PM (#28451231)

Does anyone know if any of the current crop of standard databases make use of things like Direct IO (where available on Linux), I’ve seen some write-ups that indicate you can get eye-wateringly fast performance when combined with an nvme drive.

[ Parent | on HN ]

Re:My £4 a month server can handle 4.2M requests a day by rapsey on Tuesday September 07, 2021 @11:42PM (#28452755)

Scylla is built arround direct io.

[ Parent | on HN ]

Re:My £4 a month server can handle 4.2M requests a day by PeterCorless on Friday September 17, 2021 @11:37AM (#28566721)

Specifically, aio (async io).

[ Parent | on HN ]