There are a lot of reasons small Android phones didn't work. One of the biggest reasons Android went to bigger form factors first was because they needed the extra battery capacity. Android was a bit of a battery hog and, CPUs on the higher end Android phones were pretty demanding. That last bit is likely the biggest reason small form factor Android died an untimely death.