Re:Ask HN: Devs using LLMs, how are you keeping costs low fo...
by spruce_tips on Thursday July 18, 2024 @11:13AM
(#40996325)
options if im not using langchain?
[ Parent
| on HN ]
Re:Ask HN: Devs using LLMs, how are you keeping costs low fo...
by ricktdotorg on Thursday July 18, 2024 @12:21PM
(#40997173)
Cloudflare AI gateway [0]
[0] https://developers.cloudflare.com/ai-gateway/configuration/c...
Re:Ask HN: Devs using LLMs, how are you keeping costs low fo...
by spruce_tips on Thursday July 18, 2024 @01:54PM
(#40998120)
options if im not using cloudflare?
Re:Ask HN: Devs using LLMs, how are you keeping costs low fo...
by throwaway888abc on Thursday July 18, 2024 @04:23PM
(#40999364)
You can do it easily with object caching / function memorization patterns in any modern language which should fit your desired solution. Best of luck!
Re:Ask HN: Devs using LLMs, how are you keeping costs low fo...
by retrovrv on Thursday July 18, 2024 @11:35PM
(#41001850)
there's an open source ai gateway - https://github.com/Portkey-AI/gateway