That said, the video does show the model identifying facial and other body features, so it’d be interesting To know if this model _could_ be capable of working with a full sign language (ASL or otherwise).

It also got me thinking about how LLMs might handle signs as tokens, and it seems you did too! Would you just detect unique handshapes and hope the LLM could do the rest? Could you somehow encode orientation/movement/direction/locations and facial expressions? I presume current LLMs don’t have much training input on this kind of language - would we need to train new LLMs to even have a hope of them “understanding” 3-dimensional language?