I'm guessing if they wrecked off of Brazil, they never made it back to Roman territory.

There are stories of Japanese and Chinese fishing boats washing up in what is now Washington and California, so I definitely think it's possible.