Re:OpenGPT-2: We Replicated GPT-2 Because You Can Too
by godelski on Saturday August 24, 2019 @09:29PM
(#20790785)
Interesting. I'm doing ML in a niche area so I'm wondering if I can get funding (for my PhD). Obviously there's politics involved, but honestly I just want to try out methods and experiment (typical grad student I guess). So if they have a funding route I'm stoked. Thanks for the info.
[ Parent
| on HN ]
Re:OpenGPT-2: We Replicated GPT-2 Because You Can Too
by dgacmu on Monday August 26, 2019 @08:32AM
(#20799281)
In most programs, if you get accepted into the Ph.D. program, you're funded. Obviously, you should check first. Different programs treat these things differently with TA requirements, but most Ph.D. students are funded by an "RA" (research assistant, aka, doing your actual eventual-thesis research...).
For more info, my colleague Mor wrote a very useful doc about the Ph.D. process in CS: https://www.cs.cmu.edu/~harchol/gradschooltalk.pdf
Re:OpenGPT-2: We Replicated GPT-2 Because You Can Too
by godelski on Monday August 26, 2019 @04:53PM
(#20803655)
Oh I'm funded. Definitely was told not to go unless I'm fully funded. But $500k for computing resources is bigger than a lot of small term contracts (I'm mostly on research and usually don't have to TA unless there's a hiccup in funding schedules. Gov money...). I definitely see that amount for long term, but this seems like a pretty short project.
Re:OpenGPT-2: We Replicated GPT-2 Because You Can Too
by dgacmu on Tuesday August 27, 2019 @06:00PM
(#20814870)
Got it. (1) Yes, 500k is a lot, but (2) the TFRC program is making fairly expensive TPUs available at shockingly good prices for researchers willing to do some tire-kicking and feedback-providing. So 500k of TPU time is easier to come by than, say, 500k of generic compute.