Concrete tends to get weakened by fire. So even if the concrete doesn't burn, the home may need to be rebuilt because the concrete has been dangerously weakened by the fire. Stone and brick can also be damaged by fire. They are more resistant to fire but in a really hot fire, they may not be resistant enough.