Re:NeurIPS 2020 “English to Bash” Competition Goes Live
by tmabraham on Tuesday July 21, 2020 @01:43PM
(#23908974)
Just try GPT-3...
[ Parent
| on HN ]
Re:NeurIPS 2020 “English to Bash” Competition Goes Live
by speedgoose on Tuesday July 21, 2020 @02:18PM
(#23909328)
So dubious bash completion requiring a cluster of GPUs in a a closed cloud and the energy of a hydroelectric dam to run?
Re:NeurIPS 2020 “English to Bash” Competition Goes Live
by melling on Tuesday July 21, 2020 @02:38PM
(#23909522)
Does it really matter how it’s solved the first time?
The second version can require three orders of magnitude less hardware. Premature optimization is the root of all evil.
Re:NeurIPS 2020 “English to Bash” Competition Goes Live
by speedgoose on Tuesday July 21, 2020 @03:42PM
(#23910173)
Isn't the whole point of GPT-3 to have tons of data and hope for the best by training it with a huge amount of time and energy ?
Re:NeurIPS 2020 “English to Bash” Competition Goes Live
by setr on Tuesday July 21, 2020 @03:54PM
(#23910308)
For training -- using the trained algorithm is cheap. It's a one-time cost (well, one-time in the final version)
Re:NeurIPS 2020 “English to Bash” Competition Goes Live
by DSingularity on Tuesday July 21, 2020 @04:03PM
(#23910396)
You do realize that reducing costs means dropping parameters. So what you are suggestion is reversing the very technique that enables this result. Color me doubtful.
Re:NeurIPS 2020 “English to Bash” Competition Goes Live
by jnwatson on Tuesday July 21, 2020 @04:08PM
(#23910453)
It doesn't. There exist far more sophisticated techniques to reduce the size of a neural network while minimizing loss of accuracy.