"Physically based" rolls off the tongue more easily, and the adverb "physically" is modifying the verb "based", and then "physically-based" or "physically based" combines into an adjective or sometimes an adverb.