News for hackers. Stuff that matters.

A comment on The Coming of Local LLMs. Parent comment

Re:The Coming of Local LLMs by whimsicalism on Tuesday April 11, 2023 @01:17PM (#35528125)
There is literally no way that GPT-4 is using classic O(N^2) attention exclusively. They haven't released the results, but I promise you this is not what they are using exclusively.
[ Parent | on HN ]
Re:The Coming of Local LLMs by anthlax on Wednesday April 12, 2023 @09:03AM (#35538982)
Interesting! How do you know this?
[ Parent | on HN ]