Here's a trick to help get you started:
Write a relatively simple C program that does something useful that you understand thoroughly, then generate intermediate assembly code from your C compiler, with optimization turned off.
That way you get a problem that you already know how to solve in a .s listing that you can inspect and modify to your hearts content.
Then try to optimize it, make it run quicker by rearranging stuff.
You'll learn lots that way and the barrier to entry is low.
The difference between Intel/MASM syntax and AT&T/GNU syntax is rather superficial[1], so with a little squinting you can use a MASM book with the GNU assembler. Newer versions of the GNU assembler also come with a directive .intel_syntax so you can write your learning programs in MASM syntax.
[1]http://www.ibm.com/developerworks/linux/library/l-gas-nasm.h...
Also, check out http://webster.cs.ucr.edu/AoA/
The Netwide Assembler (NASM) which I mention in the article frontpage has the same syntax as MASM without the nasty licence. Some of the assembler directives may differ, but 90% of your program will be identical.
Any ideas?