Re:CryptoCat iOS Application Penetration Test [pdf]
by lis on Thursday April 03, 2014 @04:32AM
(#7521588)
We have a pretty cool submission system in use at my university, that will spin up a VM, compile and run your code and have a set of validators check if the output is correct. That way people can test their submission and immediately get feedback.
You would still have to look into the code to make sure it's really valid, but I guess you could filter out lots of invalid submissions.
If you are interested, I can hook you up with one of the developers of that system.
Two things complicate managing the challenges:
* We have to actually read the code people send us (if you get things wrong, there's a pretty good chance we'll catch it). We try hard not to move people forward a level until they've gotten the previous challenges right.
* We don't dictate any particular format for submissions. Some people paste code into their email messages; some people attach lots of little files; some people attach archives. Some languages let you stick all that code in 1 file; others, like Java and C#, have complicated directory hierarchies.