For Emacs Lisp: I just looked at the info pages for emacs. There are some books, never touched them so can't comment. But if you know CL, Emacs Lisp is not a stretch to learn as it's about 90% the same (especially since they made some changes in the past decade or so to better support lexical scope by default).
For Scheme: Check out The Little Schemer and the rest of that book series. Unique presentation style, but very approachable if you get past it (some people don't, I liked them).
I am a big fan of the little family of books by Friedman et al.
- Little schemer
- Seasoned schemer
Are a good start.There is also Practical common lisp which and land of lisp which are usually recommended by people.
Hope that helps somewhat.
It looks like it's been kept up to date and you could do worse than starting there, especially in an Emacs context.
Here is the online version in case you don't know how to navigate info manuals yet: