There is an alternative: you can use a MIME envelope to store notes. This way you’ll have a plaintext container and a way to attach files in a portable way.

I’ve built a note taking system based on this idea: https://github.com/knazarov/notes.sh