I definitely agree with you that it is no replacement for walking, yoga, or other active forms of exercise. But I have found it a great substitute for just sitting while using a computer.
I say this because I had some prostate bruising (I recovered from that quickly doing yoga), but I attribute it to sitting too long; I don't even want to think what a pedaling motion in my chair would do down there! Granted, I have never pedaled in my chair so I accept that maybe it is fine—I'm just not willing to take the risk.
Personally, I'd go more for a walking desk or something where the motion is natural, but the desired cardio effect is the same.
For cardiofitness you need to get your heartrate over a certain threshold. A walk won't do that.
Unfortunately I can't find my sources right now, so take that as just something some guy said on the Internet.
And if that's not enough, you can always speedwalk.
It can if you choose it, for reasonable levels of cardio.
If you are only going to do one thing (not advocating that!) you aren't going to be able to beat walking, especially on varying terrain.
For instance, sitting down too much is in itself detrimental to ones health (whether pedaling or not). E.g. prostate health, posture, etc.
In contrast, a stationary bike or road bike, the rider can stand up and pedal fast, etc. There's a much broader range of motion which make the activity healthy!