I just read a lot on Wikipedia, where island is defined as a "sub-continental land surrounded by water"[1]. But when you look at the definition of sub-continental, the continents are "generally identified by convention rather than any strict criteria"[2].
So it's just convention that large islands like Greenland, Madagascar and New Zealand, which are "pieces" of continents, are not considered continents. Some pieces of continents such as New Caledonia[3] are much smaller than volcanic islands that rose out of the sea. For what it's worth, wikipedia follows the norm and calls Greenland the largest island[4].
And then there's the whole issue of sea level which varies, and as it does, it changes the size, shape, and connection of islands and continents.
[1] http://en.wikipedia.org/wiki/Island [2] http://en.wikipedia.org/wiki/Continent [3] http://en.wikipedia.org/wiki/New_caledonia#Geography [4] http://en.wikipedia.org/wiki/Geology_of_Greenland
(I've always said Australia, but it seems many people exclude it and go with Greenland.)