[edit: yup, vector - https://en.wikipedia.org/wiki/Vector_graphics#Applications]
i guess when they used the device they must trigger some kind of raster scan. that would explain why they had to hold it in place.
http://history-computer.com/ModernComputer/Electronic/SAGE.h...
http://www.wps.com/projects/Charactron/
EDIT: Ooh, better information in this PDF: http://design.osu.edu/carlson/history/PDFs/p19-hurst.pdf
The Typotron was like a Charactron, but could store data, too. Apparantly the light gun was used only to click on light points, not on dark bits of the tube, so it was 'trivial' to determine what was clicked on (the second page of the PDF talks about how the light gun was basically invented and prototyped in one day somewhere in '48 or '49).
Since a vector display always knows what object it is drawing a particular time, the presence of light at the tip of the gun is all you need to identify the object.