News for hackers. Stuff that matters.

bitRAKE

The early exit can be done without an extra flag, but increased code size.
Long term is fuzzy, but the 3D chip tech seems poised to offer exactly that: massive cache, GPU and CPU cores. NVidia isn't going to play nice because they don't like where this positions them in this future. AMD, Intel and Apple don't seem to need NVidia. This tension is bad for end-users.
Re:LLaMA: A foundational, 65B-parameter large language model on Friday February 24, 2023 @03:47PM (#34929907)
The 1.4T tokens are what the model was trained on, and not the token range of the embedding.