You could give Concrete Abstractions* a try, I consider it to be the intermediate part between the Little Seasoned Schemer and SICP. As for whether you're really missing out on anything depends on how good your good CS education was.

* https://gustavus.edu/mcs/max/concrete-abstractions.html