News for hackers. Stuff that matters.
Re:Qwen2.5-Coder-32B is an LLM that can code well that runs ... by simonw on Wednesday November 13, 2024 @09:40AM (#42126445)
Honestly I don't think I have the right temperament for being a reliable source for evals. I've played around with a few ideas - like "Pelicans on a bicycle" https://simonwillison.net/2024/Oct/25/pelicans-on-a-bicycle/ - but running evals well on an ongoing basis requires a focus and attention to detail that isn't a great fit for how I work.

Here's Qwen 2.5 Coder 32B for "Generate an SVG of a pelican riding a bicycle" https://gist.github.com/simonw/56217af454695a90be2c8e09c7031...

Re:Qwen2.5-Coder-32B is an LLM that can code well that runs ... by tucnak on Wednesday November 13, 2024 @09:59AM (#42126601)
"Pelican on a bicycle" is really fun, honestly. I hope it doesn't go the way of the unicorn! :-D