ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations

Re:ALBERT: A Lite BERT for Self-Supervised Learning of Langu... by nl on Wednesday January 08, 2020 @06:35PM (#21996967)

I've been using ALBERT (the HuggingFace port) for a few weeks. It works fine on GPUs, and it isn't noticeably slower for inference than other large models on CPUs.

It's worth noting that TPUs are available for free on Google Colab.

[ Parent | on HN ]

Re:ALBERT: A Lite BERT for Self-Supervised Learning of Langu... by danieldk on Thursday January 09, 2020 @01:00AM (#21998898)

It's worth noting that TPUs are available for free on Google Colab.

Yes, and you can also get a research grant, which gives you several TPUs for a month. But that does not mean that you can easily deploy TPUs in your own infrastructure, unless you use Google Cloud and suck up the costs (which may not be possible in academia).

[ Parent | on HN ]