News for hackers. Stuff that matters.
Re:Apple: Transformer architecture optimized for Apple Silicon by spacebanana7 on Friday March 24, 2023 @06:44AM (#35287334)
Could you explain how supporting multiple languages increases the parameter count so much? I'm genuinely curious.

LLMs seem to be comfortable with hundreds of programming languages, DSLs and application specific syntaxes so how does supporting a couple more natural languages become so expensive?

I see how more training data would be needed, but I don't understand how that maps to a greater parameter count.

There are no comments on this comment yet.