Show HN: I wrote a minimal deep learning library from scratch in Python

Re:Show HN: I wrote a minimal deep learning library from scr... by kristoo on Tuesday March 23, 2021 @03:42PM (#26559453)

Nice! Out of curiosity, did you build it to learn/practice the low level concepts of deep learning? If so, was it worth it?

[ Parent | on HN ]

Re:Show HN: I wrote a minimal deep learning library from scr... by montebicyclelo on Wednesday March 24, 2021 @09:12AM (#26566727)

Thanks. Yes, I did. During the process of making this [1] more basic autodiff framework, I realised that it could become actually usable if the values the "Variables" contained were NumPy arrays. Then I just found myself chipping away it at.

It was worth it for me, since I found it fun to work on, learned many things, and want to continue learning in this area.

A limitation is that one only has to work out the local gradients of operations, which may or may not provide insight into the more complicated models composed of these operations.

[1] https://sidsite.com/posts/autodiff/

[ Parent | on HN ]