The normal people did exactly like you thought they would, placing a few pieces around, with a lot of off-by-one errors. The chess pros, on the other hand, got board positions comparatively "more wrong" than the beginners. Multiple pieces were radically moved across the board. However, when these board positions were looked at by other pros, the responses were almost universally along the lines of "well, the positions are different, but strategically they're actually kinda similar..."
It's qualitative feedback, to be sure, and difficult to verify and certainly not be trusted in a scientific sense. Nonetheless, it does reveal some of the "intuition" going on. Pro chess players are good at seeing high-level patterns in the positioning of the pieces, related to strategies and advantages and relative positioning. They see these things so well that they stop seeing the actual pieces, to an extent. It reminds me of that scene in the first Matrix movie where the one guy (Cypher?) is pointing to the screen with numbers trailing down, saying "I don't see the numbers anymore, it's just blonde, brunette, redhead, ..."
This seems to relate more to perception than to intuition as it's traditionally thought of, but I would argue that they two are more strongly coupled than most people realize. One type of intuition is perceiving emergent phenomena directly without noticing the underlying layers.
The general point is the same: the pros perceive the board differently, because they see the emergent patterns. My contention is that this is the heart of intuition (or at least an important subset of intuition).
The advantage of training with an AI is that the AI will happily play you for ten or twelve hours a day, from any position you please, without tiring; you can ask it for the evaluation of any position, and it will generally provide an extremely accurate one; it will immediately reveal errors in your calculations and suggest tactical possibilities that few humans would see; and it will play perfect (for small sets of pieces) and near-perfect endgames against you.
Last, but not least, computer chess databases are like nothing available 20 years ago. Chess professionals (and amateurs) have access to all the games they have ever played, hundreds of games played by any potential rival, and hundreds or thousands of games played by IMs and GMs in any potential opening line.
Yeah, you're probably right. I had also forgotten about those chess databases, those are quite powerful. The problem is probably that the last commercial chess AI I used dates from ~1995, when they weren't that smart yet. Or, more accurately, the computers didn't have enough computing power to be strong and at the same time take a reasonable amount of time before playing.
They also misplaced groups of pieces instead individual pieces in meaningful positions.
Make perfect sense with pattern matching, pros obviously think in terms of patterns more than amateurs.
But this is still far from knowing in any significant detail how pro think in patterns.
Here's a link I found on Google: http://projects.ict.usc.edu/itw/gel/EricssonDeliberatePracti...
This is a truism of expertise. Although we tend to think of experts as being weighted down by information, their intelligence dependent on a vast set of facts, experts are actually profoundly intuitive. When experts evaluate a situation, they don't systematically compare all the available options or consciously analyze the relevant information.
References? Studies? It sounds very plausible but...
It would help if the one link the article wasn't inside a paywall too.