Re:Show HN: We Built an API for AI Calling
by janestevenson80 on Monday October 02, 2023 @03:06PM
(#37742899)
Just read through and wondering if you could shed a bit more light onto how you’re decreasing latency? Also would like to learn more about the types of prompting you found to be effective.
Re:Show HN: We Built an API for AI Calling
by slopedintercpts on Monday October 02, 2023 @03:09PM
(#37742923)
Self hosting is huge - you don't have to wait in queues like everyone else, and can host in a region close to other servers. Similarly, just getting on the enterprise tiers of the services you use can also guarantee lower latency.
Re:Show HN: We Built an API for AI Calling
by slopedintercpts on Monday October 02, 2023 @03:14PM
(#37742997)
Yeah, all the safety concerns are very valid. Easiest immediate fixes that we're building into our system are 1) preventing people from scaling before doing KYC, 2) creating a content moderation filter on the AI's prompts
Will do more as we grow.