Almost every town has some code that says you can't do that.

Or the house is already built, and tearing it down to make a brick one is $$$ plus permit maybe will be denied.

And most homebuilding companies only use wood.