Re:Mistral: Our first AI endpoints are available in early ac...
by infecto on Monday December 11, 2023 @08:04AM
(#38600283)
Not true. Not everyone is building chat bot or similar interface that requires output with latency low enough for a user. While your example is of course incredibly slow, there are still many interesting things that could be done if it was a little bit quicker.
[ Parent
| on HN ]
Re:Mistral: Our first AI endpoints are available in early ac...
by stavros on Monday December 11, 2023 @08:06AM
(#38600302)
What kind of use cases run in an environment where latency isn't important (some kind of batch process?) but don't have more than 4GB of RAM?
Re:Mistral: Our first AI endpoints are available in early ac...
by wongarsu on Monday December 11, 2023 @09:18AM
(#38600822)
Price sensitive ones, or cases where you want the new capability but can't get any new infrastructure.
Re:Mistral: Our first AI endpoints are available in early ac...
by TeMPOraL on Monday December 11, 2023 @10:12AM
(#38601305)
Not LLMs, but locally running facial and object recognition models on your phone's gallery, to build up a database for face/object search in the gallery app? I'm half-convinced this is how Samsung does it, but I can't really be sure of much, because all the photo AI stuff works weirdly and in unobservable way, probably because of some EU ruling.
(That one is a curious case. I once spent some time trying to figure out why no major photo app seems to support manually tagging faces, which is a mind-dumbingly obvious feature to support, and which was something supported by software a decade or so ago. I couldn't find anything definitive; there's this eerie conspiracy of silence on the topic, that made me doubt my own sanity at times. Eventually, I dug up hints that some EU ruling/regs related to facial recognition led everyone to remove or geolock this feature. Still nothing specific, though.)