The metadata for cross-chain swaps are stored right on the blockchains for everyone to see.

The same time-locked hashes which make atomic swaps safe, permanently tag both sides of a completed atomic swap transaction with a unique hash making it easy to link them together.

Atomic swaps are not designed to prevent tracking of funds.