And you can take sets as something built on top of categories (specifically, topoi), so category theory is more foundational than set theory.
http://plato.stanford.edu/entries/category-theory/
http://plato.stanford.edu/entries/category-theory/
I strongly disagree with your last paragraph though.