This is an intriguing idea; kind of like the method used in "Lingua Latina per se ilustrata" but automatic and with rich media. This is definitely possible, though the domain space is quite large, some tradeoffs would have to be made that might stifle the exact vision.