It is more complex that that: hot food might not be taxed if it is "to go" (Starbucks and their breakfast sandwiches ....), Whole Foods will always apply tax to its food bar items, the ice cream parlor down the street will apply sales tax if you say "for here" but not if they assume take out.

It is very very confusing, and I haven't really figured it out yet.