Re:Jepsen: Datomic Pro 1.0.7075
by jupp0r on Wednesday May 15, 2024 @09:06PM
(#40374191)
In practical terms, if you are a database and Jepsen doesn't find any bugs, that's as much assurance as you are going to get in 2024 short of formal verification.
[ Parent
| on HN ]
The work antithesis has been doing here has me really excited as well.
Re:Jepsen: Datomic Pro 1.0.7075
by stuarthalloway on Thursday May 16, 2024 @11:19AM
(#40379472)
Formal verification is very powerful but still not full assurance. Fun fact: Testing and monitoring of Datomic has sometimes uncovered design flaws in underlying storages that formal verification missed.
What kind of flaws? I would expect performance problems.
To start with, you usually perform verification on a behavioral model and not on the code itself. This opens up the possibility that there are behavioral differences between the code itself and the model which wouldn't be caught.
Could you offer an example?
If you work through the TLA+ tutorial[1] it will help you get a good idea of the benefits and limitations of verification.