News for hackers. Stuff that matters.
Re:Show HN: NCompass Technologies – yet another AI Inference... by adiraja on Monday December 16, 2024 @02:58PM (#42434732)
Hey, great that you mentioned this. We actually had BAAI/bge-m3 on our list of models to put up in the near future to see if people had use for it over an API. It's great to hear that this is something you're looking for. If you could let us know if there was a specific model you wanted to run, we can look into getting that put up soon.
Re:Show HN: NCompass Technologies – yet another AI Inference... by tarasglek on Tuesday December 17, 2024 @03:33AM (#42439509)
Colbert, colqwen are underserved would benefit from a latency optimized inference service
Re:Show HN: NCompass Technologies – yet another AI Inference... by adiraja on Tuesday December 17, 2024 @03:47AM (#42439572)
Awesome, we really appreciate the suggestions! We'll look into getting these up and running shortly!