Is there really a harm in calling it trespassing?
"Breaking and entering" appears to have originated as a English legal doublet [0] -- a pair of words with origins in different languages with similar meaning adopted as the language of the law changed. As an aid to clarity.
> Is there really a harm in calling it trespassing?
Well, yes, because:
(1) "Breaking and entering" already has another name, "burglary". [1]
(2) "Trespassing" is the name of another, broader and, by itself less serious, crime of intrusion onto property without permission.
[0] https://en.wikipedia.org/wiki/Legal_doublet
[1] See, e.g., https://en.wikipedia.org/wiki/Breaking_and_entering
You could try to change the names, but it honestly doesn't matter. Many people also don't know the difference between assault and battery. No one really thinks it's okay to threaten others with physical violence even if no blows are dealt, though. Similarly, no one really thinks it's acceptable to enter someone's home without permission even without literally "breaking in". The laws around these are generally reasonable even if the legal names aren't exactly what people expect.