News for hackers. Stuff that matters.

A comment on Facebook LLAMA is being openly distributed via torrents. Parent comment

Re:Facebook LLAMA is being openly distributed via torrents by spencerchubb on Friday March 03, 2023 @07:37AM (#35008738)
I fail to see how this is different from other software in that regard. If you have parameters but not the network architecture, then it's not very useful.
[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by renonce on Friday March 03, 2023 @08:44AM (#35009528)
You do need to guess things like activation functions, number of attention heads, order of attention layers, etc. Often the parameter names reveal something about these.
[ Parent | on HN ]