No excuses: http://www.khanacademy.org
There is a book Math for game programmers or something, I forgot, but these are the basic tools you have as a graphics programmer. I'd argue you need to expand knowledge into physics if you want to be a good graphics programmer (optics), and without some calculus, namely integration, forget about advanced graphics programming. You could do it, but you won't understand it - you'll end up waiting for others to code examples and publish non-scientific papers in order to understand what you need to do. Thus, you will always lag behind cutting edge and won't be able to read published papers and implement/expand them.
I have kind of a bad memory, so I have these two books I find very helpful when I want to refresh my pre-calculus knowledge: http://www.amazon.co.uk/Mathematics-Physical-Sciences-Robert... and http://www.amazon.co.uk/Further-Mathematics-Physical-Science...
And how much calculus is required to have a chance at understanding the material?
It might be nice to have some study groups in the bay area for people looking to get into this with a regular schedule.
It can be found here: http://ocw.mit.edu/courses/mathematics/18-06-linear-algebra-...
Assuming no class is available, depending on how deeply you want to learn the subject, linear algebra is fairly accessible. It sounds like the introductory level stuff (University 200 level) is what is recommended in that article, so the good news is you don't need a class to learn it.
I don't think not having calculus would prevent learning it at this level. Personally I'd just look at reviews for linear algebra textbooks on Amazon and buy the best one. One thing I often do when trying to learn a subject on my own is a go to the University bookstore to figure out what materials I should start with.
Then just read the chapters and work the sample problems. When doing any matrix manipulation by hand (boring, but good to verify and help internalize understanding) it's easy to use that software to check results.
Basic linear algebra is one of the easier mathematics to teach one's self.
What kind of non-position are you talking about?
At least here in Germany, there's absolutely no problem with attending a linear algebra lecture as a guest. Just ask the lecturer whether it's okay for him/her, and everything is fine.
But of course, you need to be close to a university with decent linear algebra lectures, have enough time and so on. That's harder.
So all you need is a university that provides natural sciences. I can't imagine such a university being hard to find.
When I was in university, we learned graphics programming by taking a linear algebra course or two. This was applied in a graphics course in which all students built their own software renderer, from top to bottom.
I have seen coworkers who never learned matrix math fumble with obfuscated code that could be replaced with one line of matrix operations. Several game companies I have interviewed at make linear algebra a very big part of their technical interview process. IMO if you are even remotely comfortable with math, learning matrix math is a HUGE benefit (maybe even a necessity) if you want a serious job as a game developer... the easiest way to get going with it is to just take a university-level intro to linear algebra course. That is all you need to understand the math underneath the entire rendering pipeline.