Fishing, at a low enough volume, it is sustainable, which humans have been doing for dozens of millennia.

The problem comes when the threshold is reached and passed. That is specifically the tragedy of the commons. It's a fractal problem - i.e., even if one country fixes the issue through regulation/taxes/prohibition, another country may still overfish a shared body of water.

The "full cost" wouldn't need to be replacing each fish caught. It would be a fee/tax to ensure a sustainable fish population - this could still result a reasonable market for fish.