A patch is a derivative work, no matter how you try to dodge that part of the law. So it would still be violation of copyright.
For example, the original work might be very valuable, a significant work. It could be the collective work of many authors. But it has been made available for free. The derivative work, maybe patches or some additional source code by a single author, is also valuable but on its own much less so.
Then the large original work is packaged together with the patches and additonal source code as a "derivative work". It is commercially licensed to an end user who sees the value as a whole, most of it coming from the original work, which of course was available for free.
Depending on whether attribution is given, the user may have no idea that the core of the product was open source and available for free.
More importantly, there appears to be no assessment of the relative "value" of the free portion versus the closed-source commercial portion of the product.
(Edited to add the last statement above, for clarity.)
Absolutely you can sell, but your can't restrict user rights
You can legally do this, but it will not be easy. You cannot distribute a binary in this way, if you do your patch becomes GPL so the first person who buys your patch can legally give it to everyone else. That means you have to sell the source code to your patch and your customers have to build the binary themselves. You need to ensure that your customers understand that they cannot distribute any binaries they make. (they probably can distribute it within their company but they need to have some process to ensure that their employees know they cannot distribute this)
If anyone is thinking about this, make sure all sales include your lawyer: you will need to ensure that your customer understands all the subtleties otherwise the courts might decide your patch is GPL.