But that's the point. Entropy changes. If entropy changes, events are irreversible.
As a crude simplification the less an event leaks entropy, the closer it is to being reversible.
Microscopic events - low-energy atomic collisions and particle collisions - can appear perfectly symmetric in time. So much so that microscopic reversibility is considered a thing in physics and chemistry.
What actually happens is more subtle than that, because quantum indeterminacy makes it impossible to exactly reverse a quantum event. Instead of Newtonian precision you have to settle for a probability density of possible outcomes.
But even so, you can't tell which direction time is running in many particle interactions. The particles aren't altered in any appreciable way, and no information/energy leaks to the surroundings.
So even though the difference between before and after isn't precisely deterministic, you still can't tell whether time is running forwards or backwards, because there's no entropic delta to give you a clue.
On the other hand, if you see a "video" of two warm, vibrating billiard balls colliding, which then cool off and stop vibrating, it's still only a good guess that the video is in reverse. It's only highly improbable that the motion of the atoms in the billiard ball, air, table, etc cancel out to produce more order, not impossible. That improbability, AFAICT, is the linchpin of the Second Law of Thermodynamics.
The physicist takes copious notes, precise measurements, and spends the rest of the day furiously scribbling in his notebook. Finally the physicist shouts excitedly, and rushes into the farmhouse.
The farmer says, "Did you figure it out?" And the physicist says, "I did! But it only works for spherical chickens in a vacuum."
For instance, if you have an electron placed some distance away from another negative charge source, you could very easily model its dynamics. But there is no fundamental difference between this electron being repelled from the other negative charge compared to a positron that is being attracted to the charge, but moving backwards relative to our perception of time. So it is a forward moving electron or a time-backwards positron? There's no difference, they're both completely physical systems.
Boltzmann's big accomplishment, one that was at his time rejected until Einstein's description of Brownian motion, was his completion of the H-theorem (which Claude Shannon subsequently named his information-theoretical counterpart for), which describes that physical systems under very simple assumptions (uncorrelated position and momentum vectors) will 'relax' to a distribution of energies given by the maxwell-boltzmann distribution. It turns out, however, that these assumptions are not completely valid for physical systems, so the H-theorem is not really considered a 'true' explanation. I highly suggest reading the wikipedia article on Boltzmann's H-theorem that goes into the mathematical derivation of the positive-definite nature of time derivative of entropy of a closed system.
<wild speculation> So what are the real answers as to the arrow of time? It's an unsolved problem, but I have guesses. The most obvious answer for things like this is based on the anthropic principle. In an informational world, one could assume that everything that we interact with all moves in the same time direction because DNA is effectively some Turing-equivalent string of 1s and 0s that is modified by the 'computation' of evolution. Memory of the timeline is encoded into DNA, which is what we are from an information perspective.
Chances are, however, that things like this will never be proven, possibly because in this case the proof will be non-computable by Turing machines like us. It isn't even unreasonable to think that the 2nd law of thermodynamics and P!=NP are not equivalent statements and equally unprovable. Am I far out there enough yet? </speculation>
I've seen this image used more than once to make the point, but now I think about it, I don't think it works. It is only acceptable if we think of billiard balls as ideal elastic spheres. They are good illustrations of the concept of "ideal elastic sphere" in our material life -- but they aren't, really, and that destroys the thought experiment.
Let's run the tape at super-duper slo-mo, shall we? The two balls slowly approach, collide, rebound. But now at super-duper slow-mo we can see that, being actual collections of atoms, they behave somewhat like water-balloons. At the point of contact, there is deformation, flattening, and rings of compression waves radiate away, to meet at the other side of sphere, interfere, and come back. (Something of the sort happened to Saturn's moon Mimas.)
So if we play the video in reverse, it is quite easy to tell the "before" from the "after". In reverse, we have balls that, as they roll toward each other, develop increasing concentric ripples of deformation that start from the opposite sides and shrink rapidly to the contact faces, disappearing completely at the moment of contact, and two unperturbed balls separate.
The only way the billiard balls image works is if we instead use ideal perfect spheres of adamantium. Even balls of titanium or diamond would have some kind of internal elastic shape change that would exist only "after" and not "before" the collision.
Which is simply to admit that in the real world, there are no collisions that are actually reversible even in principle.