Re:The Tensor Cookbook
by thomasahle on Sunday February 02, 2025 @04:42AM
(#42907523)
Standard tensor notation in pytorch and other libraries is very indirect, and often shapes are only documented in comments.
I definitely find it helps to draw parts of your architecture as a tensor diagram. Or perhaps use a library like tensorgrad which makes eveything explicit.
I am really lost here if I have missed something about indices notations with tensors or some visualization techniques. Or maybe the confusion of a tensor operation depends of the field? Or maybe I just miss practices and experiences with indices notations...