Re:AI Found a Bug in My Code
by andai on Thursday November 17, 2022 @03:47AM
(#33636412)
>probability of each token appearing given the previous tokens
Sounds like tokenizer -> Markov chain? Surely something trained on a TPU is more sophisticated than something we could have done in the middle of the 20th century?
Sounds like tokenizer -> Markov chain? Surely something trained on a TPU is more sophisticated than something we could have done in the middle of the 20th century?