News for hackers. Stuff that matters.

A comment on Toki Pona: an attempted universal language with only ~120 words. Parent comment

Re:Toki Pona: an attempted universal language with only ~120... by weinzierl on Sunday August 13, 2023 @04:42PM (#37114229)
I always wanted to train an LLM from scratch. There is an interesting project that does just that with Esperanto and my immediate thought was I'll do it with Toki Pona. Unfortunately, I had vastly underestimated the size of the existing Esperanto corpus and overestimated size of the Toki Pona corpus.

So, I gave up on that idea because I believe that there is not enough training data, but I'd love to be proven wrong.

[ Parent | on HN ]
Re:Toki Pona: an attempted universal language with only ~120... by grondilu on Sunday August 13, 2023 @04:49PM (#37114300)
> There is an interesting project that does just that with Esperanto

That is intriguing. Link?

[ Parent | on HN ]
Re:Toki Pona: an attempted universal language with only ~120... by weinzierl on Monday August 14, 2023 @03:56AM (#37118542)
https://huggingface.co/blog/how-to-train
[ Parent | on HN ]