ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations

Re:ALBERT: A Lite BERT for Self-Supervised Learning of Langu... by nl on Wednesday January 08, 2020 @06:36PM (#21996975)

I'm sorry, but why would you run a model like ALBERT on a CPU in the first place?

It's pretty common to run inference on CPUs. There are lots of operational and cost reasons why this makes sense in at least some cases.

[ Parent | on HN ]

Re:ALBERT: A Lite BERT for Self-Supervised Learning of Langu... by peterjussi on Wednesday January 08, 2020 @08:10PM (#21997541)

I would even say: in every case, except where a GPU or TPU is necessary to achieve a certain speed. Unless there are very specific reasons for it, GPU/TPU is just unnecessarily cost inefficient.

[ Parent | on HN ]