Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by xyproto on Monday April 21, 2025 @04:48PM (#43756300)

This is very convenient and nice! But I could not get it to work with the best small models available for Ollama for programming, like https://ollama.com/MFDoom/deepseek-coder-v2-tool-calling for example.

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by codingmoh on Monday April 21, 2025 @05:01PM (#43756426)

Thanks so much!

Was the model too big to run locally?

That’s one of the reasons I went with phi-4-mini - surprisingly high quality for its size and speed. It handled multi-step reasoning, math, structured data extraction, and code pretty well, all on modest hardware. Phi-1.5 / Phi-2 (quantized versions) also run on raspberry pi as others have demonstrated.

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by xyproto on Tuesday April 22, 2025 @03:09AM (#43759744)

The models work fine with "ollama run" locally.

When trying out "phi4" locally with:

open-codex --provider ollama --full-auto --project-doc README.md --model phi4:latest

I get this error:

      OpenAI rejected the request. Error details: Status: 400, Code: unknown, Type: api_error, Message: 400
    registry.ollama.ai/library/phi4:latest does not support tools. Please verify your settings and try again.

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by smcleod on Monday April 21, 2025 @04:58PM (#43756392)

That's a really old model now. Even the old Qwen 2.5 coder 32b model is better than DSv2

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by codingmoh on Monday April 21, 2025 @05:02PM (#43756430)

I want to add support for qwen 2.5 next

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by manmal on Monday April 21, 2025 @05:20PM (#43756625)

QwQ-32 might be worth looking into also, as a high level planning tool.

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by codingmoh on Monday April 21, 2025 @05:30PM (#43756709)

Thank you so much!

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by smcleod on Tuesday April 22, 2025 @03:24AM (#43759843)

Hopefully Qwen 3 and maybe if we're lucky Qwen 3 Coder might be out this week too.

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by smcleod on Tuesday April 22, 2025 @03:26AM (#43759854)

Also GLM 4 is pretty amazing - https://www.reddit.com/r/LocalLLaMA/comments/1k4w9p2/i_uploa...

[ Parent | on HN ]

Re:Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs by codingmoh on Tuesday April 22, 2025 @06:29PM (#43766898)

Thanks, I'll have a look

[ Parent | on HN ]