By default, yes, but if you then explicitly override that with robots.txt or a TOS, those take precedent. (Again, I'm not talking legally here, just what's been the cultural custom for the past 20 years or so. In other words, if you ignore either and then get banned, I don't think many netizens would shed a tear for you.)