Perhaps two judging categories could help. Best technical feat this weekend, and best business concept. Bonus points for the business concept that actually built some kind of MVP this weekend.
There's a grey area between new hacks that use existing APIs/tech from a startup (vs. publicly available tech) and completely new projects. Not sure how that should be handled, perhaps just a case-by-case basis (is this a feature for the startup, or is it a brand new project that happens to leverage existing knowledge?)
The strongest complaint we could make was that it was strongly against the spirit of a hackathon, which is a difficult argument to win.
I mean, nobody here can even say "wow, I won't go to their next one!" because you haven't even named them.
Our team was tired out after all-night coding and really didn't possess the mental finesse at the time to walk the fine line between arguing "the results don't fit the spirit of the event" and "we are sore losers".
I was at Angelhack NYC last time it was held, and was disappointed in that way also. The winner, and indeed a lot of contestants, had code or designs that were impossible to generate in a 48 period.
There was a "code review" clause in the rules, but I did not see it ever enforced. Some of the high-ranking (the ones that made it into the final round of judging anyways) projects had clearly pre-cooked designs and mockups (this wasn't against Angelhack's rules), and obviously little to no working code. Many presentations were slide decks. Disappointingly few showed the core idea working.
I've always thought that the spirit of a hackathon was to get together with some crazy smart people and see what useful and worthwhile things you can bang out in a limited time. Precooking 95% of your project beforehand seems rather against the spirit of this.
Personally I've resolved to stop going to corporate-sponsored hackathons, or hackathons where investors are waiting at the sidelines. There's a tremendous misalignment of incentives and it encourages a rather ruthless atmosphere. It's no longer about good clean fun and all about attracting investor attention.
Question: anyone in NYC know about low-key hackathons where it actually fits the spirit of a hackathon?
The slide deck thing is a persistent problem and one we're not happy with. I think that kills it for everyone and its disappointing when judges are impressed by them. To change this, starting this Fall we'll be the first hackathon to disallow power point presentations and require teams to demo if they'd like to win.
Given that the hackaton might be 2 days, unless your idea is 'simple' enough to have a MVP in 1 day (never seen it happen), the second day will be all preparation for the presentation because this is what will win a jury.
For those of us who had built working products, it felt more than a bit cheap. We saw some great code and very little of it was recognized.
I believe the issue is one of expectations and marketing for these events. They are pitched as "hackathons" and try very hard to attract engineers, as you simply can't have the event without coders. Therefore, engineers reasonably expect an event where the best code wins. After all, it's called a "hackathon", not a "meet & greet with investors" or even a "startup weekend". In the end, it just felt like the judges were putting themselves into the mindset of investors, and in that case, obviously the team that has prepared for months beforehand will win. But to the coders, we felt cheated, and that they had completely missed the point.