Re:Yagrad – 100 SLOC autograd engine with complex numbers an...
by spadufed on Monday March 18, 2024 @12:46PM
(#39746794)
What are some common examples of complex numbers in these sorts of applications?
[ Parent
| on HN ]
Re:Yagrad – 100 SLOC autograd engine with complex numbers an...
by noway421 on Monday March 18, 2024 @01:35PM
(#39747359)
Here complex numbers are used for an eloquent gradient calculation - you can express all sorts of operations through just the 3 functions: `exp`, `log` and `add` defined over complex plane. Simplifies the code!
The added benefit is that all the variables become complex. As long as your loss is real-valued you should be able to backprop through your net and update the parameters.
PyTorch docs mention that complex variables may be used "in audio and other fields": https://pytorch.org/docs/stable/notes/autograd.html#how-is-w...