News for hackers. Stuff that matters.

bertobugreport

Re:A Replacement for Bert on Thursday December 19, 2024 @05:31PM (#42466419)
Trying to fine tune on single rig multi-gpu and it crashes, going back down to 1 GPU fixes and training continues (excited to see its results).

Script is near identical with the one below, updated with new imports;

https://huggingface.co/docs/transformers/en/tasks/token_clas...