The claim that you could build a house out of the fragments comes from the 1500s, so that's the number that matters if you're checking the veracity of that claim.

There are far less now that Protestants spent a century destroying purported fragments.