"SVMs. . .3)can be trained online, which makes them great for huge datasets (here the point 2) might not apply - but there exist ways - if someone's interested I can point out some papers)"

Please do. I want to read some about SVMs since i haven't heard that much about them.