Re:15k inserts/s with Rust and SQLite (2021)
by gomezjdaniel on Sunday April 02, 2023 @05:42PM
(#35415557)
> I made a prototype message queue in Rust that processed about 7 million messages/second. That was running from RAM.
Can you share the source code?
Re:15k inserts/s with Rust and SQLite (2021)
by andrewstuart on Sunday April 02, 2023 @06:52PM
(#35416138)
It was pure garbage - a failed attempt to learn Rust.
Re:15k inserts/s with Rust and SQLite (2021)
by re-thc on Sunday April 02, 2023 @08:34PM
(#35417041)
Need some garbage collection added?
Re:15k inserts/s with Rust and SQLite (2021)
by marginalia_nu on Sunday April 02, 2023 @05:54PM
(#35415669)
To be fair it's very easy to outperform a DBMS by not offering ACID guarantees.
Re:15k inserts/s with Rust and SQLite (2021)
by osigurdson on Sunday April 02, 2023 @09:13PM
(#35417334)
Agree. I know for Postgres, we are getting at least 50K / second sustained and not doing anything special - other than using bulk insert.
I made a prototype message queue in Rust that processed about 7 million messages/second. That was running from RAM.
I also had a prototype that ran from disk and it very rapidly maxed out the random write performance of the SSD. Can't remember the number but it was in the order of 15K to 30K messages a second, bottlenecked by the SSD.
If the sqlite test is writing to disk it is likely also bottlenecked at the disk.