News for hackers. Stuff that matters.
Re:Ceph: A Journey to 1 TiB/s by mrb on Friday January 19, 2024 @08:23PM (#39063678)
You are probably right. Reading some old notes of mine when I was fine-tuning PCIe bandwith on my ZFS server, I had discovered back then that a PCIe Max_Payload_Size of 256 bytes limited usable bandwidth to about 74% of the link's theoretical max. I had calculated that 512 and 1024 bytes (the maximum) would raise it to respectively about 86% and 93% (but my SATA controllers didn't support a value greater than 256.)
Re:Ceph: A Journey to 1 TiB/s by _zoltan_ on Saturday January 20, 2024 @04:10AM (#39065868)
Mellanox recommends setting this from the default 512 to 4096 on their NICs.