Re:OpenAI – transformer debugger release
by dfgtyu65r on Tuesday March 12, 2024 @07:27AM
(#39678278)
Normally, the LLM is composed of multiple transformer blocks, where each block consists of the (mutli-head) attention and fully-connected feedforward components. These are then stacked on top of each other to give the final output of the network.
[ Parent
| on HN ]
There are no comments on this comment yet.