News for hackers. Stuff that matters.
Re:GPT-3 is no longer the only game in town by rg111 on Tuesday November 09, 2021 @12:08PM (#29164306)
We used Flax, of course.

We thought Haiku was cool, but none of us knew it, and learning resources were scarce. But we are very happy with Flax.

We used the Bengali subset of the mC4 dataset [0] for training the GPT-2 model.

[0]: https://huggingface.co/datasets/mc4

There are no comments on this comment yet.