I think the glitchy colors arise because the image overflows the 0..255 range of uint8 which is usually used for digital images. The values should be clamped when converting from float to int.