Bricks are actually very poor insulators.

A wood-frame house with the framing elements filled with appropriate thicknesses of insulation is a very, very much better insulated structure than one made (only) of brick.