News for hackers. Stuff that matters.

A comment on Sparks of Artificial General Intelligence: Early Experiments with GPT-4. Parent comment

Re:Sparks of Artificial General Intelligence: Early Experime... by nl on Monday March 27, 2023 @02:12AM (#35323436)
GPT-4 has a token window of 32K tokens. I don't think GPT-4's vocabulary size has been released but GPT-3 is 175K. I guess yes, the complexity is technically measurable but it does seem pretty large!
[ Parent | on HN ]

There are no comments on this comment yet.