News for hackers. Stuff that matters.

k11kirky

k11kirky on Hacker News

Re:Show HN: AgentServe – A open-source framework for hosting scalable ... on Thursday October 31, 2024 @11:57AM (#42008152)
Thanks! Would love any feedback on how to improve it

Show HN: AgentServe – A open-source framework for hosting scalable AI agents

Posted by k11kirky on Wednesday October 30, 2024 @01:03PM
from the show-hn dept.

https://github.com/PropsAI/agentserve

Hey HN!I am super excited (and slightly nervous) to introduce AgentServe!What is AgentServe?AgentServe is a framework to make hosting scalable AI agents as easy as possible. With 4 lines of code AS wraps your agent (any framework) in a FastAPI and connects it to a Task Queue (celery or redis).Why Should You Care?Standardized Communication Pattern: AgentServe proposes that all agents should...

( Read More... | 2 comments | 5 points | on HN )
Re:Ask HN: Do people want to AB test LLMs? on Friday October 11, 2024 @11:09AM (#41810176)
Thank you again - Great context for me
Re:Ask HN: Do people want to AB test LLMs? on Thursday October 10, 2024 @01:59PM (#41801445)
Thats great feedback - thank you! I would then assume most people would end up using open source models as they tend to be cheaper with faster inference
Re:Ask HN: Do people want to AB test LLMs? on Thursday October 10, 2024 @01:58PM (#41801435)
Thanks, do you think there is value in evals? / do you use evals while testing prompts?

Ask HN: Do people want to AB test LLMs?

Posted by k11kirky on Thursday October 10, 2024 @12:11PM
from the ask-hn dept.

Hi Hacker News,My name is Peter and I am the founder of Props. We are an AI Gateway that enables product teams to AB test models and providers using traditional business metrics (rather than evals) to measure performance.For example: In a traditional call center, companies use NPS, CSAT, Ticket close rate ect. to measure performance. Our theory is that regardless of whether the call center is...

( Read More... | 9 comments | 2 points | on HN )
Re:I built an AI jobboard as an acquisition strategy for my AI SaaS tool on Thursday May 16, 2024 @12:38AM (#40375233)
Built over a weekend it now generates over 10k views a month and my SaaS product https://getprops.ai is the main ad at the top of the page. It drives around 1% of traffic to Props.

What ideas have you tried to drive more free traffic to your products?

We open sourced the core of our SaaS. Did we make a mistake?

Posted by k11kirky on Friday February 23, 2024 @05:05PM
from the self-post dept.

Hey Hacker News,Ever tried explaining your the unit level economics of your AI company to your cat and realized even they looked at you like you're making it up? Well, we've been there. That's why we built a cost monitoring tool for OpenAI that's so good, even your cat would approve. We help you see what user/request/process/gremlin is causing your costs to skyrocket and make sure you know your...

( Read More... | no comments | 2 points | on HN )
Re:Show HN: Props AI – A Free Tool for Cost-per-User Visibility for Op... on Monday February 05, 2024 @04:28PM (#39267455)
Sure! Do you have a specific integration you would like me to add?

Show HN: Props AI – A Free Tool for Cost-per-User Visibility for Open AI

Posted by k11kirky on Monday February 05, 2024 @03:54PM
from the show-hn dept.

https://getprops.ai

Hey HN,I am excited to launch Props AI. A Free tool that provides cost-per-user insights and visibility for you apps built on Open AI's API.For those of us building GenAI apps, There is a disparity between how we pay for LLMs (Tokens) and how we charge for them (Per month). Its hard to know your COGS or Unit Level Economics with a single bill at the end of each month from Open AI, so I build a...

( Read More... | 3 comments | 2 points | on HN )