News for hackers. Stuff that matters.
Re:Using a Markov chain to generate readable nonsense with 2... by andy99 on Sunday November 12, 2023 @06:25AM (#38239299)
How would you calculate or estimate a "parameter count" from the "trained" model? I'd like to be able to compare to small transformer models e.g. some of the very small llama or gpts. Would it just be the number of (w1,w2) pairs that have entries... possible times the total vocabulary size, but I think that would be unfairly sparse. So maybe times the number of unique entries for each pair?

There are no comments on this comment yet.