News for hackers. Stuff that matters.

A comment on Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model. Parent comment

Re:Show HN: Talk to Transformer – Generate Text with OpenAI'... by AdamDKing on Monday May 06, 2019 @01:23PM (#19841629)
The site was using one K80 GPU but it's slowing down significantly so I'm adding a second GPU. The servers run on Google Kubernetes Engine.
[ Parent | on HN ]
Re:Show HN: Talk to Transformer – Generate Text with OpenAI'... by minimaxir on Monday May 06, 2019 @01:54PM (#19841959)
I'm also working on implementing that particular workflow with GPT-2/GKE/GPUs (I'm curious on your deployment strategy if you want to talk more).

You may want to use preemptible GPUs if you aren't already.

[ Parent | on HN ]