This is how I learned (approximately) how GPT-2 worked. Start with GPT-2 and it's full of nonsense you don't understand. Follow the references, follow more references. Get to basic neural networks with one hidden layer like you learned about in college. Reverse the chain and build upwards.