News for hackers. Stuff that matters.

A comment on Show HN: Up to 100x Faster FastAPI with simdjson and io_uring on Linux 5.19. Parent comment

Re:Show HN: Up to 100x Faster FastAPI with simdjson and io_u... by Sesse__ on Monday March 06, 2023 @06:12PM (#35049175)
0.2% really isn't free. If you have a data set of 10 TB (one small-ish HDD right now, or one large SSD), that's ~20 GiB in page tables alone. If you can use 2MB pages, then sure, but I would assume that also limits your page-in granularity.
[ Parent | on HN ]
Re:Show HN: Up to 100x Faster FastAPI with simdjson and io_u... by loeg on Monday March 06, 2023 @06:37PM (#35049450)
Oh, you're right. I wasn't remembering we needed PTEs to cover the data not paged in as well as the data in RAM. Sorry.
[ Parent | on HN ]