News for hackers. Stuff that matters.
Re:Ferret: A Multimodal Large Language Model by Apple by shrimpx on Saturday December 23, 2023 @04:50PM (#38748596)
- FaceID

- Facial recognition in Photos

- "Memories" in Photos

- iOS keyboard autocomplete using LLMs. I am bilingual and noticed in the latest iOS it now does multi-language autocomplete and you no longer have to manually switch languages.

- Event detection for Calendar

- Depth Fusion in the iOS camera app, using ML to take crisper photos

- Probably others...

The crazy thing is most/all of these run on the device.

Re:Ferret: A Multimodal Large Language Model by Apple by pants2 on Saturday December 23, 2023 @07:07PM (#38749594)
The iPhone's built in text OCR and image subject cutouts are also extremely good, just in the photos app.
Re:Ferret: A Multimodal Large Language Model by Apple by shrimpx on Saturday December 23, 2023 @07:10PM (#38749612)
Yeah totally, I copy text from images all the time.
Re:Ferret: A Multimodal Large Language Model by Apple by kergonath on Monday December 25, 2023 @12:55PM (#38764568)
The combination of automatic OCR and translation almost everywhere in the OS is great.
Re:Ferret: A Multimodal Large Language Model by Apple by pkage on Saturday December 23, 2023 @04:57PM (#38748661)
I just wish you could turn the multilingual keyboard off—I find that I usually only type in one language at a time and having the autocomplete recommend the wrong languages is quite frustrating
Re:Ferret: A Multimodal Large Language Model by Apple by shrimpx on Saturday December 23, 2023 @05:09PM (#38748769)
That's true, I have found that mildly annoying sometimes. But most of the time it's a win. It was really annoying manually switching modes over and over when typing in mixed-language, which I do fairly often. It'd be great if there was a setting though.
Re:Ferret: A Multimodal Large Language Model by Apple by cezart on Sunday December 24, 2023 @03:26AM (#38752094)
I had the opposite problem, the languages I usually typed in(Romanian + English) didn't have a multi language mode on iOS. So it was a constant pain to switch btw them when I needed to insert some English terms in Romanian sentences. IOS didn't support multi language for this language pair. On Android it always worked like a charm.
Re:Ferret: A Multimodal Large Language Model by Apple by shrimpx on Sunday December 24, 2023 @05:10PM (#38757438)
Hey I'm Romanian, too. The latest iOS does what you want -- it has multi-language support and typing mixed English + Romanian is seamless now. Yeah it was a total pain to keep switching languages before iOS 17.
Re:Ferret: A Multimodal Large Language Model by Apple by hansoolo on Saturday December 23, 2023 @06:25PM (#38749325)
To be honest I distrust Microsoft with swift key, but the it recognizes the change in language just smooth. I could switch languages in one sentence and it would understand what I am writing just fine, no Sill suggestions
Re:Ferret: A Multimodal Large Language Model by Apple by Aerbil313 on Saturday December 23, 2023 @11:39PM (#38751183)
Apple recommending wrong words when you write in mixed-language was the case in iOS 15, so much I always needed to manually change my keyboard language. But it’s no more in iOS 17. As an example I just typed this entire comment in Turkish keyboard with English autocorrect and suggestions working.

Maybe the (most likely) AI-based thing requires some training though. I got my new iPhone a month or so ago.

Re:Ferret: A Multimodal Large Language Model by Apple by fennecbutt on Monday December 25, 2023 @11:18AM (#38763779)
SwiftKey is great and if someone distrusts Microsoft for it...then fine, but various different companies "control" various different parts of my phone.

With an iPhone, it's only one company, that controls every little thing, and we have no insight into Apple at all. They can basically do whatever the hell they want.

Re:Ferret: A Multimodal Large Language Model by Apple by fennecbutt on Monday December 25, 2023 @11:16AM (#38763763)
Yeah face id is pretty good, no android phones seem to use the ir dot camera which makes me think Apple has a "patent" on it ...lame considering the dot projector is ripped straight out of kinekt.

Google does the memory photo thing too, but only if you use their app which I don't.

Android has had multi language keyboard support for the longest time, in addition to being able to install whatever keyboard I like (I use SwiftKey, it's brilliant) I can also install an llm based one as I please.

Android/my keyboard already does event detection/suggestion in text and has been doing for as long as I remember.

None of these are reasons to buy an iPhone...just reasons to buy a phone, lmao.

Re:Ferret: A Multimodal Large Language Model by Apple by jmisavage on Monday December 25, 2023 @01:09PM (#38764696)
FYI Apple bought the company that made the kinect sensors. The Face ID module on iPhones is a mini kinect.