Yes, it's wrong to be dismissive like that. But no, "toy language" does not have a specific meaning. It is a slang insult, not a proper technical term.