News for hackers. Stuff that matters.
Re:Optimizing a Ring Buffer for Throughput by gpderetta on Tuesday June 27, 2023 @05:30AM (#36490745)
They should be in the same cacheline as you suggest. The writer will always touch both writeIdx and readIdxCached so it makes sense to be together. Splitting them won't affect synthetic benchmarks, but it just wasting space in a larger application.
Re:Optimizing a Ring Buffer for Throughput by rigtorp on Tuesday June 27, 2023 @06:46AM (#36491178)
There might be an additional optimization in having the writer also cache it's write index on the cache line together with the read index cache. This way the writer would only do writes to the write index cache line. The hardware might be able to optimize this. I wonder how it interacts with UMWAIT on the latest cores.
Re:Optimizing a Ring Buffer for Throughput by gpderetta on Tuesday June 27, 2023 @07:11AM (#36491318)
Reading its own values is never a problem, the writeIndex cacheline will switch from E (or M) to S (or O), but it is never evicted, so reads from it never miss. For frequent writes the read will be fulfilled by the store buffer anyway.
Re:Optimizing a Ring Buffer for Throughput by rigtorp on Tuesday June 27, 2023 @08:59AM (#36492105)
I think it will be invalidated due to RFO when the reader reads the write index. Only when multiple readers reads the same cache line without any intervening write will the RFO heuristic be disabled.