I feel that you have to be careful with that definition insofar as the objects in a category may not form a set at all but a proper class.