You probably won't have too many problems, Google and friends have had a long running project to get the kernel to compile with clang.

Unfortunately, they're not done yet. A guy I bumped into at a Linux kernel conference once said that their main issue is that some people within the kernel project want to keep GCC as the only way to compile the kernel.