News for hackers. Stuff that matters.

A comment on Qwen2.5 Turbo extends context length to 1M tokens. Parent comment

Re:Qwen2.5 Turbo extends context length to 1M tokens by christianqchung on Monday November 18, 2024 @05:17PM (#42177723)
Transformers absolutely do not run in constant time by any reasonable definition, no matter what your point is.
[ Parent | on HN ]
Re:Qwen2.5 Turbo extends context length to 1M tokens by anon291 on Monday November 18, 2024 @05:35PM (#42177845)
They absolutely do given a sequence size. All models have max context lengths. Thus bounded by a constant
[ Parent | on HN ]