They must have been made out of natural fibers originally, but I would imagine a big problem with that would be that they would absorb water and become very heavy.
Cotton also absorbs water.
Most of the problem is that a billion pounds of fishing nets are left in the ocean every year, harming wildlife.
If someone knows what fishing nets were made of before they were made of plastic, please chime in.