(The fact that many of these books were rushed out with very poor quality control also didn't help.)
Google's algos, while advanced, still rely a ton on text to actually tell what the page is about. They need it.
If they just relied on other factors (title, links, website, etc.) they would end up with worse results for users. Im sure they've tested it.
Google's core algo in a lot of ways is much simpler than people think (in other ways of course it's very complex).
What's the point of writing succinct, to-the-point mini articles about problems and solutions if nobody finds them on Google?
I've done blogging for the last 10+ years, and many of those I spent as a freelancer working with startups/brands/editorials. Everyone is after "word count" and I absolutely hate it.
Whenever I work on articles for my own blog, I just don't consider word-count at all. I think if your content is great and informative, then readership will be natural.
Later on, I sold it because I needed the money. Not so much that I didn't want to keep working on it. Unfortunately, the new owners didn't have any idea how to maintain a "healthy" content blog, and it has plummeted down to around 30,000 monthly visitors. All the content they're publishing now is some thin headline-clickbait bullshit.
I even gave them free advice on how to fix it, but I think that for a lot of people, they just don't care and will mindlessly pump out as many pieces of content as possible. And such blogs can be identified from a mile away.
And therein lies the problem with Google SEO at the moment. Even myself, someone who has done SEO work for more than a decade, I can see that results are getting worse. In some niches, the same crappy articles that dominated 6-7 years ago are still dominant today.
I guess we're stuck in time, or so Google thinks.
Incidentally, prioritizing long content seems odd to me, in my experience the best pages are short and get right to the point, at least in the context of something like a recipe or other "how to" resources.