Re:"Attention is all you need" paper digested
by random3 on Saturday October 07, 2023 @05:21PM
(#37805678)
Maybe, but it would have surfaced regardless, either directly or through related things. While the transformer may evolve into the next thing, it's equaly likely the next evolution will be unrelated to transformer.
Moreover while the transformers and current LLMs are a leap, the monoculture around them is not necessarily a good thing, defocusing many good researchers from otherwise promising tech.
Finally, cross-polination of ideas is where the magic happens.
Moreover while the transformers and current LLMs are a leap, the monoculture around them is not necessarily a good thing, defocusing many good researchers from otherwise promising tech.
Finally, cross-polination of ideas is where the magic happens.