You can build various, vastly different operating systems around the same kernel. When people refer to "Linux phones", they usually mean the family of systems often referred to as GNU/Linux distributions, which Android very clearly doesn't belong to.