News for hackers. Stuff that matters.

A comment on Show HN: Open-source coding assistant with terminal access. Parent comment

Re:Show HN: Open-source coding assistant with terminal access by kevinlu1248 on Thursday February 08, 2024 @10:16PM (#39310957)
We have tried many of the current open source models but unfortunately the only model whose capability is close to GPT-4 is Deepseek and unfortunately Deepseek can’t follow our specified format and is very sensitive to prompt changes.
[ Parent | on HN ]
Re:Show HN: Open-source coding assistant with terminal access by kevinlu1248 on Thursday February 08, 2024 @10:25PM (#39311006)
The other problem is with latency: Deepseek 34B on A100s seem slower than GPT-4 but perhaps it will be better on H100s.
[ Parent | on HN ]