News for hackers. Stuff that matters.

A comment on Show HN: Saving Money Deploying Open Source AI at Scale with Kubernetes.

Re:Show HN: Saving Money Deploying Open Source AI at Scale w... by brianllamar on Tuesday May 14, 2024 @11:40AM (#40356392)
This was a good read. Seeing the story of AI infrastructure is a breath of fresh air. Too much witchcraft and hand waving in the AI space at the moment.
[ Parent | on HN ]
Re:Show HN: Saving Money Deploying Open Source AI at Scale w... by jpmcb on Tuesday May 14, 2024 @11:42AM (#40356419)
> Too much witchcraft and hand waving in the AI space at the moment.

Yeah +1: I found most frameworks (like langchain, llamaindex) to be abit too magical for my taste where as the well understood and well structured OpenAI API makes for building ontop of inference much easier. Things are moving really, really fast, but I'm excited for where they're headed.

[ Parent | on HN ]