ASL (or any language's sign language) isn't a simple translation of gestures for words or letters; the different sign languages have their own grammars and a different "vocabulary". Think of every sign language user as being bilingual, with a sign language and a written language.