That's an excellent point. Perhaps this is another case where it would be better to rewrite the sentence:

"Frankly, your work has been awful."