News for hackers. Stuff that matters.

A comment on Deepseek Coder V2 Beats GPT-4o, Opus.

Re:Deepseek Coder V2 Beats GPT-4o, Opus by anotherpaulg on Monday June 17, 2024 @02:32PM (#40709289)
The new Deepseek Coder V2 model [0] is now atop aider’s code editing leaderboard!

It’s worth noting that it is only capable of using aider’s “whole” edit format. This means it returns a modified full copy of each file when it makes changes. Most other strong models are able to use aider’s “diff” editing format, which allows them to return diffs of edits – saving time and token costs and avoiding limits on output tokens.

[0] https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruc...

[ Parent | on HN ]
Re:Deepseek Coder V2 Beats GPT-4o, Opus by ai_what on Monday June 17, 2024 @03:57PM (#40710306)
Was the lite model also tested?
[ Parent | on HN ]
Re:Deepseek Coder V2 Beats GPT-4o, Opus by anotherpaulg on Monday June 17, 2024 @04:01PM (#40710387)
No. I just benchmarked against the API at deepseek.com, which doesn't appear to serve the lite model.
[ Parent | on HN ]