News for hackers. Stuff that matters.
Re:Better and Faster Large Language Models via Multi-Token P... by objektif on Wednesday May 01, 2024 @02:20PM (#40227108)
Which latest trends you mean?
Re:Better and Faster Large Language Models via Multi-Token P... by renonce on Thursday May 02, 2024 @04:09AM (#40233833)
Anything that is not settled for several years, like papers published last year or so. Like RingAttention, quantization/pruning, rotary embedding, distillation, RLHF, L2 regularization, multimodal, MoE etc.