How to train large deep learning models as a startup

Re:How to train large deep learning models as a startup by agnosticmantis on Thursday October 07, 2021 @07:06PM (#28793288)

Isn’t the current best practice to train highly over-parametrized models to zero training error? That’d be a global optima, no?

Unless we’re talking about the optima of test error.

[ Parent | on HN ]

Re:How to train large deep learning models as a startup by aabaker99 on Thursday October 07, 2021 @07:35PM (#28793561)

If you find a zero in a non negative function, I would call that a global minima, yes.

[ Parent | on HN ]