Ask HN: Do you think Python will disappear for LLM inference?

Re:Ask HN: Do you think Python will disappear for LLM infere... by talldayo on Friday January 03, 2025 @11:09AM (#42586813)

No, it won't. Python is a scripting language that is more composable than Go or Rust and can even be optimized for inference just as well, at least in theory. LLM inference doesn't necessitate a strong type system which actually gives Python a bit of an advantage for less complex programs.

The only places where Go and Rust take the lead is optimizing the non-AI code that you write. That's still a valuable advantage, but it's not going to displace the use case for Python on it's own.

[ Parent | on HN ]

Re:Ask HN: Do you think Python will disappear for LLM infere... by astronautas on Friday January 03, 2025 @11:12AM (#42586842)

Indeed, my point was that Go and Rust could lead optimizing the non-AI code, which often begs to be coupled with AI code (think guardrails).

Also, what's the benefit of Python then in this case? Ergonomically, Go isn't shabby, Rust is another story though.

[ Parent | on HN ]