Re:Unsupervised translation of programming languages
by zitterbewegung on Tuesday June 09, 2020 @10:08PM
(#23473148)
Yes, it is and I agree with you.
I worked in a lab where I had to reproduce others peoples code in Java. I never finished any of those projects.
For Example GPT-2 would need around ~$50k to reproduce from scratch. GPT-3 is probably a few orders of magnitude than that. How would anyone reproduce it unless they are a company? I've seen NVIDIA reproduce some results.
Also, most of the issues are you don't have the datasets and after the PhD students graduate and the professor gets a job your access of the datasets go away like bitrot.
I worked in a lab where I had to reproduce others peoples code in Java. I never finished any of those projects.
For Example GPT-2 would need around ~$50k to reproduce from scratch. GPT-3 is probably a few orders of magnitude than that. How would anyone reproduce it unless they are a company? I've seen NVIDIA reproduce some results.
Also, most of the issues are you don't have the datasets and after the PhD students graduate and the professor gets a job your access of the datasets go away like bitrot.