Exactly. The problem is that you lose searchability. On the filesystem, Calibre organizes your library in a series of subdirectories named by author. If you want to find a book by title, or some other criteria... or even when it's a book with multiple co-authors and don't know which one Calibre selected as the primary... then you'll have a bad time.