If you built with brick that would be against code and you’d be incredibly likely to die if there is an earthquake.

Additionally, Americans are fairly fond of tearing down existing structures to rebuild which is harder to do with brick.

Thirdly, wood is an abundant resource in the US.