Seconded on the eye protection. Also, drill slow (without too much pressure) and drill a pilot hole so you stay centered.

There are special plexiglass drills, those make life a bit easier, a glass bit works as well (even better, actually).