News for hackers. Stuff that matters.

A comment on Large language models are having their Stable Diffusion moment. Parent comment

Re:Large language models are having their Stable Diffusion m... by jerpint on Saturday March 11, 2023 @08:25PM (#35115237)
That’s a great question - typically memory in transformers scale as O(N^2) with token count, so there must be an upper limit, but I would bet it to be far more than 4096 tokens
[ Parent | on HN ]

There are no comments on this comment yet.