Relationships (and by association the normal forms) provide extremely important information/hints to the query optimizer and allows it to do stuff like join elimination[1]. It is my belief that SQL's bad name came from the widespread use of MySQL's partially functional engine and the poor performance caused by the lack of a proper query optimizer.
Aside: sometimes normal forms do cause too much additional overhead during queries, which is when you can use materialized views[2].
Not to mention that a normalized database is ripe for translation into analysis forms (cubes etc.), and that advanced tooling generally has a better understanding of normalized databases.
Basically, there are many more reasons (above the valid ones that you give) to have normalized forms and describe referential integrity.
[1] http://antognini.ch/2010/01/join-elimination/ [2] http://en.wikipedia.org/wiki/Materialized_view
It came from the fact that mysql doesn't support joins properly. I do not believe this has been fixed, as far as I know it still only supports nested loop joins.
Even then it's a far cry away from "the big guns." Things like statistics, DPVs, etc. simply aren't (edit: or weren't) present in MySQL: which are more examples of a critical components of efficient database design at massive load scales.
TLDR; MySQL simply isn't competitive, it's being improved (especially MariaDB) but is a long ways off.
[Edit] I'm refuting that this:
> MySQL supports transactions, row level locking, nested SQL, and even replication
is relevant in the context of what he said.
Even your comment, stating that MySQL doesn't maintain statistics, it's totally wrong and easily checked with 5 seconds of Googling.
To your edit: The idea that a DBMS would support so many advanced features and do nested loop joins is laughably ridiculous.
Can you provide documentation on other join methods?
[0] - http://dev.mysql.com/doc/refman/5.6/en/explain-output.html
http://www.xaprb.com/blog/2013/10/01/mysql-isnt-limited-to-n...
It doesn't do hash joins which is the biggest limitation but MySQL is pretty good a joins and certainly was never bad enough to warrant it's reputation. It's toolbox is smaller than other RDBMS products but it's not empty.
Correct. MySQL is laughably ridiculous.
[1] http://en.wikipedia.org/wiki/Don%27t_repeat_yourself