EvalAI: An Open-Source Alternative to Kaggle

Re:EvalAI: An Open-Source Alternative to Kaggle by studentrob on Thursday June 24, 2021 @09:04PM (#27625956)

What is closed about kaggle that this does differently? I've always viewed that community as extremely open, even allowing hosts the option to open source solutions or not, thus attracting more challenges and competitors.

The about page [1] for this project says,

> With EvalAI, we want to standardize the process of evaluating different methods on a dataset

Standardization often does come from openness, I'm just not sure juxtaposing against kaggle is the right move.

[1] https://eval.ai/about

[ Parent | on HN ]

Re:EvalAI: An Open-Source Alternative to Kaggle by erwincoumans on Friday June 25, 2021 @12:30AM (#27627163)

The Web Backend, Web Frontend, Submission Scoring Service, Code Execution Service (docker ikages). See also https://www.quora.com/What-is-the-technology-stack-used-in-K...

[ Parent | on HN ]

Re:EvalAI: An Open-Source Alternative to Kaggle by studentrob on Friday June 25, 2021 @12:43AM (#27627224)

The service itself? Okay, so in theory anyone could host competitions with this backend.

The lion's share of Kaggle's effort lies in their expertise in (1) making deals, and (2) making sure the challenge is legit (no bias in training data, not too easy, etc.). That's not easily replicable, so while an "Open-Source alternative" sounds good up front, the bulk of the work remains.

[ Parent | on HN ]