News for hackers. Stuff that matters.
Re:Figure 01 robot demos its OpenAI integration by imtringued on Wednesday March 13, 2024 @04:42PM (#39697213)
The easy solution is to create an additional dataset that is token aware. I.e. you take 1% of the dataset and take random tokens and split them into smaller tokens while expecting the same answer on the character level. This should force the model to learn multiple token representations of the same character strings.

There are no comments on this comment yet.