Either you work for a consultency-type company that develops products for customers, but those don't really have infrastructure, right?
OR you work for a company that has it's own product, in that case, you can always work on more features or there are more bugs to fix.
Marketing doesn't have any new direction that they want to take the product - they've been so busy holding the big client's hand. Design doesn't have any tweaks that they want made to the base system - they too have been deep in the design language of the big client, and haven't yet started to think about where they want to go next.
The result is that Engineering find themselves with nothing to do, at least as directed by management. In the better-run companies, this is the moment when the line managers start pushing out improvements to tools, cleaning up technical debt and so on. In the less well-run companies, each engineer is left to their own devices. Unfortunately you probably can't do any of those technical-debt type problems. Most of them are large jobs - that's why they weren't done in the push to get the product out the door. And nobody wants to waste time doing half of a non-sanctioned task, just to get dragged off to do something else when an urgent bug pops up, or marketing and design wake up from their post-crunch torpor. So you see a lot of fiddling around - unimportant re-factoring of code, some half-hearted doc work etc.
Also: "Always work on more features" can be a pitfall, and it's why Zawinski's law of software envelopment exists. Any feature you add can end up costing in future maintenance and difficulty in making future changes. Another thing we did during the "work on infrastructure" times was delete unused features. I was working on a 12 year old code base so there were actually a lot of those.
It sounds like there was some coordination & direction going on -- it didn't just happen automatically.
Thoughtbot strikes me as a "consultancy-type" company that has taken time out of billable hours to build infrastructure in the form of a bunch of open source libraries.
My work experience pretty much was the opposite of yours. During quiet time I was not allowed to help anyone else (I would be un-busy while they'd be overflowing with work, for which I was qualified and experienced). I was to sit at my desk and look as if I was working, even though everyone knew and accepted that I wasn't. It was v. frustrating.
Some companies drastically overcommit on a permanent basis, so that 40 hours is the minimum anyone's ever scheduled for, and when there's a lot of work, everyone's on massive overtime. These jobs can suck--these are the ones where you can end up working 100+ hour weeks on occasion, and 80+ hour weeks for months on end. Ironically, I find these are also the places where people are most likely to "look busy" in an attempt to protect themselves.
Some companies overcommit on a short-term basis, but make an attempt to average 40 hours in the long term. A lot better, and way less likely to burn people out, but still periods of suckiness. But there's a lot less need to look busy--and there will be periods of undertime, where people are just kind of dicking around.
The best job I ever had, the manager attempted to commit to 40 hours of work during peak times. But during down times, instead of letting us idle, he had us actively work on infrastructure and self-improvement. Build better tools, evaluate new tools, benchmark things, upgrade things, document things, etc. He was good at making this productive, and not "busy-work" (which is the pitfall). As time went on, these investments paid off, and we got faster and better and our 40 hours of work went a long way. And as far as I can tell, nobody ever attempted to "look busy", as the actual job was enjoyable. Sadly, this could not last, and when the dotcom crash took us down the group was dissolved. :(