Re:Language models can explain neurons in language models
by thomastjeffery on Wednesday May 10, 2023 @09:45AM
(#35887279)
Percent of what? Possible right or wrong answers to a test?
Remember that GPT is not trained on all possible text. It's trained on text that was written intentionally. What percentage of that text contains "correct" instances of causal discovery, counterfactuals, etc.?
Remember that GPT is not trained on all possible text. It's trained on text that was written intentionally. What percentage of that text contains "correct" instances of causal discovery, counterfactuals, etc.?