News for hackers. Stuff that matters.
Re:What thousands of conversations look like inside a langua... by deepsquirrelnet on Sunday November 15, 2026 @10:44AM (#50507787)
About a year ago, I made a very simple language detection model from the token embedding tensor of gemma 3. I used UMAP to show the projections of how languages separated into a 2D space. It's very interesting to look at IMO.

https://huggingface.co/blog/dleemiller/wordllama-detect

If you just want to see the plot directly: https://cdn-uploads.huggingface.co/production/uploads/65ff92...

There are no comments on this comment yet.