News for hackers. Stuff that matters.
Re:Apple’s new predictive text feature appears to be powered... by jackcook on Friday September 08, 2023 @10:04AM (#37433647)
Some context: In the upcoming versions of macOS and iOS, Apple is including a predictive text model which offers suggestions while you type, which they’ve said to be a "transformer model". I managed to find some details about this model, including details about its topology (which looks a lot like GPT-2) and its tokenizer, and I was even able to peek in and see several of its top predictions while typing!

Hopefully this can give some insight into some of the trade-offs that Apple went through to put a model on every iPhone and MacBook — it’s small, it has a pretty narrow scope, and it’s not very capable on its own.

Re:Apple’s new predictive text feature appears to be powered... by PaulHoule on Friday September 08, 2023 @10:12AM (#37433756)
The emoji interest me. I start almost everything I post on Mastodon with an emoji. I used to look these up in emojipedia but my iPad has a lot of memory pressure and I'll loose what I'm working on in my YOShInOn window if I switch between two many tabs so now I have a dropdown list of all the emoji I've actually used and only need to cut-n-paste something that isn't in the list.

Early on I thought the emoji would be associated with a clean classification (say a ringed planet for astronomy) but I found I wasn't really doing that (I used two people holding hands for a post about a possible companion for a black hole) From the very beginning I thought about making something that automatically suggests an emoji but I've yet to do anything about it: the existing models I have would treat it as a many-shot problem based on emoji I've used before but I've also thought about making something trained on definitions or plain text descriptions of the emoji and related concepts.