Y /j/ always sounds like a vowel. As I mentioned, phonetically it is one. It's just that a shortened version can act as a consonant for phonological purposes. Y as represented in yell and pretty are the same sound; it's just shorter in yell.