I have folders separated by language or concept and then category. I've got sections for books and other learning stuff, my own notes and small libraries and stuff and one for bigger projects. I symlink my own libraries I use in different projects into a central lib folder in each language's folder.

It's not the most organized bur it works for me.