You could always chop off the final softmax layer and dump out the activations of one or two layers below, which are basically an embedding, which should reflect that it's partly cat and partly truck?