The sad state of property-based testing libraries

Re:The sad state of property-based testing libraries by sunshowers on Thursday July 04, 2024 @03:00PM (#40877204)

I spent some time looking at the arbitrary crate in Rust and was left unsatisfied at the shrinking story, which I think is 90% of the value of PBT.

[ Parent | on HN ]

Re:The sad state of property-based testing libraries by matklad on Thursday July 04, 2024 @05:25PM (#40878171)

Do you have a model problem which is tricky to shrink?

I implemented a stupid simple shrinker for arbitrary, and I’d love to know a specific example where it fails to shrink in a good way:

I know at lest two interesting approaches for making that way smarter, but I don’t yet have a problem where my dumb approach isn’t sufficient.

[ Parent | on HN ]

Re:The sad state of property-based testing libraries by sunshowers on Tuesday July 09, 2024 @02:49PM (#40919484)

I think I'll have to try it out! I'm just dubious about approaches that don't put shrinking front and center.

[ Parent | on HN ]

Re:The sad state of property-based testing libraries by ruuda on Monday July 08, 2024 @03:58PM (#40908961)

Shrinking is built in to libFuzzer! (`-minimize_crash` in libFuzzer, `cargo fuzz tmin` with cargo-fuzz)

[ Parent | on HN ]

Re:The sad state of property-based testing libraries by sunshowers on Tuesday July 09, 2024 @02:47PM (#40919468)

I remember libFuzzer's shrinking not doing a great job for sophisticated structured inputs, but maybe it's worth another look!

[ Parent | on HN ]