Re:Rebuild of the Debian archive with clang
by rbanffy on Wednesday February 29, 2012 @08:30AM
(#3647684)
The ideal scenario would be if upstream projects provided embedded test code with standardized hooks so that tests could be built, executed and results collected in an automated way.
Even if we started with a small test set for some projects, it would be a huge win in the long run just to have this scaffolding in place.
Any ideas on how to make a distro-agnostic testing hook?
Re:Rebuild of the Debian archive with clang
by johnpaulett on Wednesday February 29, 2012 @12:57PM
(#3648857)
It does not necessarily have to be distro-agnostic.
Debian packages can already hook the upstream's test suite (e.g. via dh_auto_test).
From my (extremely limited and mostly dynamic language) Debian packaging experience, it seems that more often than not, packages do not use this existing hook. Not sure why that is though.
He should do some fuzz testing of these programs, with the exact same fuzz sent to the GCC versions, and then report any differences. But collecting the "results" would be hard - it's not always visible in output, you'd have to track system calls and IO.