Re:Google receives patent for attention-based sequence trans...
by tejus_vignesh on Tuesday May 09, 2023 @02:47PM
(#35878736)
Can someone explain how this will affect any open-source or transformers-based model?
[ Parent
| on HN ]
Re:Google receives patent for attention-based sequence trans...
by karmasimida on Tuesday May 09, 2023 @03:25PM
(#35879203)
It means if Google sued (not in all cases), they can block your service from using Transformer model.
Re:Google receives patent for attention-based sequence trans...
by sebzim4500 on Tuesday May 09, 2023 @05:00PM
(#35880325)
Looking over the patent, I think they would really struggle to enforce this against someone using a decoder only transformer. Which is basically everyone at this point.
Re:Google receives patent for attention-based sequence trans...
by ttul on Tuesday May 09, 2023 @05:34PM
(#35880679)
Yes, but patent US11556786B2 would perhaps give them that ability.
Re:Google receives patent for attention-based sequence trans...
by mirekrusin on Tuesday May 09, 2023 @03:22PM
(#35879159)
The party is over.