Re:GPT-4
by brokensegue on Wednesday March 15, 2023 @02:25AM
(#35164620)
the initial board state is not ever encoded in the representation they use. imagine deducing the initial state of a chess board from the sequence of moves.
Why is that interesting? The initial board layout would appear all the time in the training data.