I'm currently preparing for a course based around The Theoretical Minimum by Leonard Susskind, which (so far) seems like exactly what you're looking for. The beginning has a very quick recap of state spaces, vectors, calculus, etc. It goes over Lagrangian mechanics and conservation laws in the middle before finishing with Poisson brackets.

The table of contents also claims a chapter on E&M, but I haven't looked at that yet.