> but can only be in one directory, unless you create duplicates or symlinks or whatever.

Non-sym links do exactly this. Starting with your file in foo;

    ln foo/file bar/file

will have the file (really a reference-counted pointer) appear in both directories. It's the same location on disk and there's no overhead until you run out of inodes.