Used to be I disliked KDE for 3 reasons: 1. it made me feel like I was Doing It Wrong and stuff sometimes didn't work if I didn't use K- programs for everything (and I disliked basically all of those), 2) it was the worst-performing and heaviest (disk, memory, everything) DE around, and 3) the config was insane, in a bad way—not that you could do it, but the GUI config manager was just a damn mess.
1 has improved a ton, 3 has improved a little, and 2 isn't true anymore—Gnome is much heavier and has terrible performance by comparison (try both on a resource-constrained device if you don't believe me).
I wouldn't be surprised if XFCE has gotten a little heavier, too, so the difference between the two isn't so stark. Especially default installs of XFCE on some distros, which include a lot of extras.
Same here: I was a long-time xfce user but, over the years, I found myself using more and more KDE applications. For a friend I setup a Debian with the default KDE environment... I ended up using that myself - with not too many tweaks I just love it: the defaults are sane and if I want to change anything I can !
Has KDE changed that much or have I changed ?