News for hackers. Stuff that matters.
Re:Cerebras’s giant chip will smash deep learning’s speed ba... by typon on Thursday January 02, 2020 @08:25PM (#21942054)
They could always release figures for larger networks - they don't have to target Resnet50 (which is the MLPerf standard). I don't think anyone would hold it against them if they show massive improvements in something like GPT-2 training time (a network 37000x the size of Resnet)
Re:Cerebras’s giant chip will smash deep learning’s speed ba... by Veedrac on Friday January 03, 2020 @06:43AM (#21945077)
GPT-2 uses attention, which is very memory hungry to train, so probably won't work well. But I agree with your overall point.