If we're taking about developers here, then the experience a recent graduate needs is how to become a better, more capable developer.
In a big company, they'll have multiple senior colleagues, established processes, numerous large and varied codebases to study, and a large body of institutional experience to learn from.
In a startup, they'll have what? A frazzled technical founder with little more experience than them and no time for them, a few equally inexperienced colleagues, and a crummy Rails codebase.
You will probably not get significantly better at process and architecture design in a startup, but you will learn how to get the damn thing to work no matter what, at every stage of the process, instead of being responsible for one little feature here and there and working on tech that is likely 5-10 years old and in maintenance, bug-fixing mode.
I think working in both environments is valuable, as you probably won't see the value of unit testing, code reviews, continuous integration, and senior mentors in a startup environment, but being able to see the entire lifecycle gives you a perspective that other programmers that stay with big companies aren't as likely to see as well.
Also, I've worked in corporate environments with much worse development practices than startups, as well, mainly companies where software is not their main business. It goes both ways.