I think the biggest challenge is teacher knowledge. There just aren't many people in middle/high school classrooms that know anything about programming.

Scratch does look really cool for lower grades. I was more thinking of teaching actual production languages to high schoolers though.