Show HN: AI companions stack – create and host your own AI companions

Re:Show HN: AI companions stack – create and host your own A... by asynchronous on Thursday July 13, 2023 @01:43AM (#36705420)

Tangentially related, how much would you guys be willing to pay for a company that could deliver a local model implementation that could run on high tier consumer grade hardware at a reduced ability? I feel like even if there was some severe restrictions (model wasn't open source, DRM, etc.) I’d still be willing to fork out for it.

[ Parent | on HN ]

Re:Show HN: AI companions stack – create and host your own A... by fallingmeat on Thursday July 13, 2023 @03:04AM (#36705905)

Is this the promise of Amazon Sagemaker?

[ Parent | on HN ]

Re:Show HN: AI companions stack – create and host your own A... by FanaHOVA on Thursday July 13, 2023 @03:06AM (#36705920)

MLC Chat lets you run RedPajama 3B on an iPhone. It's free. You'd need to specify what type of model you're thinking about I guess?

[ Parent | on HN ]

Re:Show HN: AI companions stack – create and host your own A... by idkyall on Thursday July 13, 2023 @10:15AM (#36709492)

I've seen at least one startup around this idea posted on HN: https://codecomplete.ai/

Probably also tiny corp for self hosting: https://geohot.github.io/blog/jekyll/update/2023/05/24/the-t...

I think there's a tremendous concern about letting data exfiltrate to any AI SaaS offering among business execs. If you could offer an experience minus the cloud that's easy to use and has compliance/logging features, I think you'd find success from industries that are reticent sharing customer data(e.g. Banking, government) who benefit greatly from the NLP workflows that LLMs enable

[ Parent | on HN ]