News for hackers. Stuff that matters.
Re:Llama3 implemented from scratch by aDyslecticCrow on Sunday May 19, 2024 @05:33PM (#40409910)
There are too many papers throwing transformers on everything without thinking. Transformers are amazing for language but kinda mid on everything else. CS researchers tend to jump on trends really hard, so it will probably go back to normal again soon.
Re:Llama3 implemented from scratch by imtringued on Sunday May 19, 2024 @05:54PM (#40410037)
I don't know what you mean by amazing for language. Almost everything is built on transformers nowadays. Image segmentation uses transformers. Text to speech uses transformers. Voice recognition uses transformers. There are robotics transformers that take image inputs and output motion sequences. Transformers are inherently multi-modal. They handle whatever you throw at them, it's just that language tends to be a very common input or output.
Re:Llama3 implemented from scratch by Hugsun on Monday May 20, 2024 @06:05AM (#40413905)
That is not true. Transformers are being applied all over because they work better than what was used before in so many cases.