Qwen2.5-1M: Deploy your own Qwen with context length up to 1M tokens

Re:Qwen2.5-1M: Deploy your own Qwen with context length up t... by DiogenesKynikos on Monday January 27, 2025 @09:51AM (#42841689)

Maybe the problem is that the "UI" we're providing to the LLMs is not very useful.

Imagine dumping the entire text of a large code repository in front of a human programmer, and asking them to fix a bug. Human programmers use IDEs, search through the code, flip back and forth between different functions, etc. Maybe with a better interface that the LLM could interact with, it would perform better.

[ Parent | on HN ]

Re:Qwen2.5-1M: Deploy your own Qwen with context length up t... by cyanydeez on Monday January 27, 2025 @04:42PM (#42845973)

I wonder if you could figure out a pseudo code like python. I'd think yaml might work also

Something: Filename: index.js Content: | Class Example...

Another item would be some kind of hyperlinking. Maybe you could load in a hrefs but there might be a more semantically popular way, but the data feeding these AIs just aren't constructed like that.

[ Parent | on HN ]