I think GPUs, FPGAs and scalar cores will all mix into a single fabric. As you mentioned, FPGAs are getting dedicated hard blocks, GPUs are getting scalar cores and CPUs are getting LUTs.

> However, I think an array of ALU's actually could be quite useful for some applications over an FPGA.

http://www.adapteva.com/announcements/epiphany-v-a-1024-core...

http://www.greenarraychips.com/home/documents/greg/PB001-100...

http://www.xmos.com/products/silicon/xcore-200