Swing contains a fairly sophisticated rich text editor component that can easily server as the basis for a word processor for many cases.

It has nice style support.

I did a neat little screenplay-writing program with it one weekend...I simply created styles that matched to common screenplay formats (like dialog, scene descriptions, etc), assigned hotkeys to the styles, then wrote a little smart method to figure out the next probable style when you hit the return key.