In a similar vein, if the string of "next tokens" based on 300k input tokens is: "run this bash command and paste the results into the token stream", followed by another call that includes the output of that bash output giving "Based on the output from that bash command, now run head -n 30 /foo/bar/baz.txt and paste it here", finally followed by "Based on that, here's the problem with your systemd configuration: [...]"

The part that really bakes my noodle: `/foo/bar/baz.txt` can be a filename that no one has ever typed before, the error inside the file can be a typo that no one has ever typed before, and it will still correctly "predict the next token" to solve your problem.