Maybe what is meant by "abstract idea" is really "an idea in the abstract," i.e. an idea that is not used to make a machine can't be patented; it's the employment of the idea that is patentable.
Ok, you patent a machine. But that statement is vague and ambiguous at best. If I patent a machine that I built, then how could the patent apply to a different machine that I didn't build? Yet, that's the whole point: they apply to classes of machines, including machines that haven't even been built at the time that the patent is granted. The class would seem to be inherently something abstract.
If you invent a new piece of hardware, it's concrete. The ideas embodied are abstract. If you came up with hardware that works differently in a concrete way (e.g. you figured out how to use carbon in place of silicon, opening the door to entirely new categories of manufacturing) then it would be potentially patentable. Your methods would be concrete methods involving substances which are not abstract.
HTH
What's not patentable is "old idea, now on a computer for the first time" -- covering any implementation of "old idea" that nobody thought to put on a computer before, "but on a computer." That's clearly abstract. It's not an implementation. There are no implementation-specific details to put in the patent as claims (they would have to stand up to the obviousness test either individually or as a group). With nothing new except "on a computer" or "on a mobile device" it's not novel or specific and therefore not patentable.
I'm actually not going to argue the point "now if you HAD a specific implementation" because I'm not sure I actually believe in patents (or more specifically software patents) at all, but I do believe that even without a patent: if you have some source code that your competition doesn't, and you made it... and they acquire it somehow without getting a license, there are already copyright laws that protect you (so long as you can establish your own original ownership of that work) if they should decide to rip it off wholesale.
From looking at examples, "abstract" seems to mean trivial. By trivial, I don't mean obvious or silly, I mean small; i.e. an idea that can be reduced to one or two sentences, like "e-commerce shopping cart."
Otherwise it's pretty hard to distinguish ideas about software from ideas about hardware and explain why one is more patentable than the other.