That's great, especially the deterministic part. Did you run into determinism problems with two different CPU architectures for server and client?
We rely on the guarantees of Rapier's determinism. I haven't done extensive testing on the determinism claim yet, but it has held up so far.
https://rapier.rs/
https://github.com/Daxode/rapier4unity