News for hackers. Stuff that matters.

A comment on EvalAI: An Open-Source Alternative to Kaggle.

Re:EvalAI: An Open-Source Alternative to Kaggle by tmabraham on Thursday June 24, 2021 @09:14PM (#27626042)
To me this looks more like a competitor to CodaLab than Kaggle, and seems to target the ML research competition market. It seems unlike Kaggle, it doesn't seem to support things like notebooks, discussions, etc.

I might add that the comparison to Kaggle is added by the OP, I don't see it mentioned on the website anywhere.

[ Parent | on HN ]
Re:EvalAI: An Open-Source Alternative to Kaggle by studentrob on Friday June 25, 2021 @12:39AM (#27627201)
> the comparison to Kaggle is added by the OP, I don't see it mentioned on the website anywhere

It's on their github page,

https://github.com/Cloud-CV/EvalAI#platform-comparison

[ Parent | on HN ]
Re:EvalAI: An Open-Source Alternative to Kaggle by tmabraham on Friday June 25, 2021 @02:59AM (#27627900)
Ah that's unfortunate, I didn't know.

That said, my point still stands. Additionally, the comparison they did is massively unfair. I'm pretty sure Kaggle competitions have most of the feature they claim it doesn't have (ex: multiple phases, custom metrics, evaluation in environments).

[ Parent | on HN ]
Re:EvalAI: An Open-Source Alternative to Kaggle by studentrob on Friday June 25, 2021 @03:02AM (#27627912)
> Ah that's unfortunate, I didn't know.

No sweat, we can't know everything, god save the interwebs!

> the comparison they did is massively unfair.

Agreed. This is all puff

[ Parent | on HN ]
Re:EvalAI: An Open-Source Alternative to Kaggle by lopuhin on Friday June 25, 2021 @10:00AM (#27630869)
Kaggle has two parts - more popular "featured" competitions which have most of those features, but cost money to host. And then also self-hosted competitions which indeed lack all those features and are more relevant for this comparison IMO.
[ Parent | on HN ]
Re:EvalAI: An Open-Source Alternative to Kaggle by seasily on Friday June 25, 2021 @12:37PM (#27633096)
Their comparison chart is outright defamatory, as Kaggle features all of the below:

Custom metrics Multiple phases/splits Remote evaluation Human evaluation Evaluation in Environments

The actual rankings are: #1 Kaggle #2 DrivenData

Honorable mention but poorly managed: AiCrowd

No one else has any level of funding to incent performance.

[ Parent | on HN ]
Re:EvalAI: An Open-Source Alternative to Kaggle by retrovrv on Friday June 25, 2021 @03:18PM (#27635096)
The comparison is indeed quite old and hasn't been updated. I work with AIcrowd and would love to know why you think it is poorly managed. I know we have a long way to go!
[ Parent | on HN ]