Re:Understanding Transformers Using a Minimal Example
by runamuck on Thursday September 04, 2025 @08:19AM
(#45126413)
I love how you represent each token in the form of five stacked boxes, with height, weight etc. depicting different values. Where did you get this amazing idea? I will "steal" it for plotting high dimensionality data.
[ Parent
| on HN ]
Re:Understanding Transformers Using a Minimal Example
by rttti on Friday September 05, 2025 @12:09AM
(#45134908)
Great. Would love to learn what you apply it for and how it works out for you.
I think it does not scale well beyond 5 boxes (20 numbers) because the stacks become too complex to remember and identify patterns in. This is me, could be also quite individual.