Is that necessarily a bad thing? Probably not. More Americans means more workers to produce and thus, more to go around.
Also, adjusting the H1B quota downwards is a luaghable proposition. As it is, the quota runs out in less than 3 months. Your suggestion would just lead to more outsourcing (which is often not as efficient as immigration) and higher prices.
I did a bike ride across the country about 10 years ago, and it was eye opening. Much different than what I saw everyday in Orange County, CA. It's easy to keep the blinders on in our everyday lives.
No: The quota runs out in less than 24 hours.
The US could support a far higher number of people with the resources it has. This is just more incorrect zero sum thinking. Which is why, by and large, the population of the planet now is better off or at least as well off as it was 2000 years ago, when there were vastly fewer people.
Lets imagine for a moment we allow the free trade phenomenon of American exogenously financed consumerism to continue to global equilibrium, how much wealth will the country have left?
Many prominent American investors; notably Warren Buffet, George Soros, and Jim Rogers; vocally oppose these ideas.
Academic theories are good fun, but we ought to slow down and act pragmatically. A perfectly free market is just too ugly.
One wise measure of pragmatism may be to adjust the H-1B quota downward as the domestic labor market contracts to maintain the status quo (as far as I can tell this is what the discussion is really about.)
edit: Also, I feel the immigration question is more nuanced than the "classic make-work fallacy," which is a lot closer to breaking something with a hammer and feeling good about creating a job for the guy who glues it back together.