Something like that could actually work. Bricks were often assembled into the kiln that would fire them. If you could figure out a way to efficiently bake these structures they would be incredibly durable and would require no additives since you would want to use all clay.

more adobe than brick, then