Re:Phoenix.new – The Remote AI Runtime for Phoenix
by causal on Friday June 20, 2025 @12:35PM
(#44329447)
Do you have a package for calling LLM services we can use? This service is neat, but I don't need another LLM IDE built in Elixir but I COULD really use a way to call LLMs from Elixir.
[ Parent
| on HN ]
Re:Phoenix.new – The Remote AI Runtime for Phoenix
by chrismccord on Friday June 20, 2025 @01:09PM
(#44329782)
Req.post to /chat/completions, streaming the tokens through a parser and doing regular elixir messages. It's really not more complicated than that :)
Re:Phoenix.new – The Remote AI Runtime for Phoenix
by throwawaymaths on Friday June 20, 2025 @02:10PM
(#44330333)
even less complicated, just set stream: false in your json :)