News for hackers. Stuff that matters.

A comment on Three senior researchers have resigned from OpenAI. Parent comment

Re:Three senior researchers have resigned from OpenAI by calf on Saturday November 18, 2023 @07:36AM (#38318866)
As a layperson, what does the special matrix transformation do? Is that the embeddings thing, or something else entirely? Something about transformer architecture I guess?
[ Parent | on HN ]
Re:Three senior researchers have resigned from OpenAI by augustulus on Saturday November 25, 2023 @11:07PM (#38419080)
https://nlp.seas.harvard.edu/2018/04/03/attention.html
[ Parent | on HN ]