From a physical standpoint, though, if you wanted to talk about the absolute center point, you'd have to talk about the lowest level of particles, which gets into the weirdness of quantum mechanics (or maybe a lower level exists?). At that point, I really couldn't say what happens.
And I don't think it matters if the particles are point mass or not, except possibly for the absolute center. The point is that the rotating object is not just one thing, but made up of smaller things that have different velocities and acceleration. These differences in velocities and acceleration are what rotation is.
If there exists something that is not made up of smaller things which also rotates, then that would prove me wrong.
Of course, all the above is just speculation by someone who's hasn't had a physics class since high school, so take it with a grain of salt.
I think every attempt to visualize this which imagines a single object rotating is doomed. Rotation inherently implies a difference in velocities, and some attractive force keeping those velocities changing to maintain a distance. So, the existence of any attractive force, together with inertia, implies rotation and the stickiness of direction of a gyroscope. But inertia itself already implied stickiness of direction, given that a change in direction would require acceleration...
Are the particles point mass?