As for comfort, this would be more of an issue for recreational riders. The deep dish or disc wheels that racers use for speed already give a fairly rough ride.
FWIW, shock absorption has implications for control on uneven surfaces. A very stiff wheel bounces on obstructions while a flexible wheel deforms and maintains contact. Thus, softer tires and suspension font forks are extremely useful for off-road bikes.
Really stiff wheels work well on extremely smooth surfaces, so time trialists and track riders love them. Weirdly, cyclo-cross riders also love the "deep dish" rims, although more for their ability to resist mud build-up than aerodynamics.
It's also worth noting that many PRO teams run very, very standard wheels (aluminum rims with 32 spokes) for the roughest classics, like Paris-Roubaix (see http://froggy100.files.wordpress.com/2009/04/paris-roubaix.j... for a good example of the terrain).
For one thing, a typical spoked wheel uses spokes that are tightened until they stretch a small amount. When the rim is subjected to stress, it can bend a little and be pulled back into true by the spokes.
A spokeless wheel would probably need a very stiff rim that could resist deformation. This would produce a harsh ride, but problem can be solved with suspension.