News for hackers. Stuff that matters.

A comment on Qwen2.5-1M: Deploy your own Qwen with context length up to 1M tokens. Parent comment

Re:Qwen2.5-1M: Deploy your own Qwen with context length up t... by raincole on Monday January 27, 2025 @03:05AM (#42838590)
But these models don't work that well even for text when you gave them a huge context. They're reasonably good at summarization, but if you ask them to "continue the story" they will write very inconsistent things (eerily similar to what a sloppy human writer does, though.)
[ Parent | on HN ]
Re:Qwen2.5-1M: Deploy your own Qwen with context length up t... by meiraleal on Monday January 27, 2025 @07:55AM (#42840633)
We should be able to provide 2 fields, context and prompt so the prompt gets higher priority and don't get mixed with the whole context.
[ Parent | on HN ]