Amazon to invest another $4B in Anthropic, OpenAI's biggest rival

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by htrp on Friday November 22, 2024 @01:37PM (#42216257)

Control your own inference endpoints.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by its_down_again on Friday November 22, 2024 @03:24PM (#42217111)

Could you explain more on how to do this? e.g if I am using the Claude API in my service, how would you suggest I go about setting up and controlling my own inference endpoint?

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by handfuloflight on Friday November 22, 2024 @03:25PM (#42217118)

You can't. He means by using the open source models.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by datavirtue on Friday November 22, 2024 @03:30PM (#42217163)

Runa local LLM tuned for coding on LM Studio. It has a server and provides endpoints.

[ Parent | on HN ]