Yes, but it is the same with things like alcohol. Most folks that smoke pot daily don't start out that way either. Most folks that wind up with a coke habit only do it occasionally at first as well. Lots more people do these things in an actual recreational pattern - every so often. Only a portion get addicted because only a portion ever do it that often.

Yet, if someone has an incident with alcohol (for example), they might be required to attend AA meetings even if they aren't a regular drinker. Same with other drugs.

This is true even if heroin withdrawal symptoms start after just a few days. Recreational use generally isn't daily use or two days in a row.