News for hackers. Stuff that matters.
Re:Revealing example of self-attention, the building block o... by two_in_one on Saturday April 29, 2023 @11:39PM (#35759499)
Correct me if I'm wrong. Here Q, K, and V are trainable. d_k and d_v are selectable metaparameters(?) d_f - input vectors' size, N is their number, or window's size. Next time we usually process another non-overlapping set of input vectors.

There are no comments on this comment yet.