Because they can probably get accurate sizings of the fin from the photograph and scrapes in the sea floor, and no amateur will have built a submarine that big.

"Small U-boats" are small in relation to SSNs, and especially SSBNs, they're not actually small.