News for hackers. Stuff that matters.

A comment on 33TB of text data for a 1T-parameter model. Parent comment

Re:33TB of text data for a 1T-parameter model by macawfish on Sunday April 16, 2023 @12:22AM (#35587246)
One of the first transformers, BERT, was and still is bidirectional.
[ Parent | on HN ]

There are no comments on this comment yet.