Rust: Doubling Throughput with Continuous Profiling and Optimization

Re:Rust: Doubling Throughput with Continuous Profiling and O... by mesto1 on Friday February 14, 2025 @04:31AM (#43046566)

It would have been nice to see that one line change, it's not really clear to me what it would be.

[ Parent | on HN ]

Re:Rust: Doubling Throughput with Continuous Profiling and O... by vrnvu on Friday February 14, 2025 @05:10AM (#43046828)

Unclear, first they mention:

- 68.37% of CPU was spent computing these checksums. With a one-line code change to enable hardware-acceleration on Graviton via the sha2 library, this went down to 31.82%. This improvement allows us to push at least 2x more throughput from these processes without increasing our compute spend.” - Shikhar, CEO of S2

But later they say:

- Checksum Processing Efficiency: The AWS S3 Rust SDK was found to be unnecessarily recomputing CRC32C checksums. Identifying this issue led to the implementation of a simple workaround, further improving efficiency.

[ Parent | on HN ]

Re:Rust: Doubling Throughput with Continuous Profiling and O... by brancz on Friday February 14, 2025 @05:07AM (#43046816)

Thank you for the feedback! Quickly worked with the S2 team to get the screenshot from the change added (it's just enabling the hardware acceleration feature in the sha2 crate)!

[ Parent | on HN ]