I think an overlooked aspect in all of this is how dramatically judicial philosophy has changed in the past few decades, across the board. Breyer, Kennedy, O’Conner, and Alito were from a generation that believed in the notion of judging as dispensing justice from on high. Younger folks like Kagan are uncomfortable with that even when though they seek to preserve liberal precedents built on that sort of judging.
The result of that is that younger conservatives find these older precedents incomprehensible, and younger liberals have a tough time defending them on the merits. Egbert v. Boule is a good example. I think the dissent probably had the better argument if we think of Bivens as anything more than an aberration that ought to be limited to its facts. But I struggled in reading the dissent to find any reason to treat Bivens as correctly decided. I remember being skeptical of Bivens when I first encountered it as a 1L, but to my recollection the opinion at least offset the tenuous reasoning with flowing judicial rhetoric. Sotomayor’s dissent, written in a modern analytical style, doesn’t even accomplish that.
You're being unfair to the liberal justices here --- there are surprising votes from liberals on QI cases (Rivas-Villegas, Talehquah), habeas (Brown v Davenport), state secrets (Zubaydah), social spending (Vaella-Madero), and immigration (Aleman Gonzalez). You cannot simply predict a liberal justice's opinion from their ideological inclinations. Not even Breyer, who is the most boring liberal justice (he wrote the opinion on Zubaydah).
Meanwhile: Gorsuch is often surprising --- not just on the Native American sovereignty cases, but also on habeas (Shoop) and immigration (Patel, an excellent Gorsuch dissent).
The other conservative justices? Not so much! In particular: you can reliably predict Alito and Thomas, the two most blinkered justices on the court regardless of ideology.
By the way, and apropos nothing here, everyone should read Egbert v Boule, not just because it's absolutely the most ludicrous (and funny) case you'll ever read about that reaches SCOTUS, but because it's a far-reaching and bad decision.