It’s hard to tell that something directly in front of you is approaching. It’s just not something our brains are good at, compared to detecting lateral movement. Especially when it’s so unexpected. One of the first things they tell you in motorcycle safety class is that “constant bearing, decreasing range” situations are extremely dangerous.
Australian driving law/principles state that "drivers should drive at the _maximum_ possible speed that is: within the speed limit, and safe for the conditions". Notably absent in this is "within your ability" as if you're not capable of safely driving on all roads, the balance of probabilities says you probably shouldn't be driving on _any_ roads.
Ultimately yes, it’s the other driver’s fault because it’s always your job to not hit things in front of you. But OP made his vehicle into a hazard.
Example (Dutch, use Google Translate): https://www.rijnmond.nl/nieuws/124541/Flinke-boete-voor-te-l...
A truck got a fine of 1500 EUR. The example was dangerously slow (eventually 40km/h), not just slow.
Here it's mostly tractors and other farm equipment driving at those speeds.
I wouldn't assume that the driver going slowly was much under the speed limit, if at all.
It was NOT a freeway.
Also, I would often go less than 20 down a pass during the winter because I didn’t have snow tires or chains, and was passed by plenty of locals doing 60+ because they were equipped for it.
Imagine being rear ended while you are stopped at a stop sign. The difference in momentum is small and there is no significant damage.
Now imagine going 80mph down the highway and someone going 81mph hits the back of your car. Still a very small difference in momentum, but your car is very likely to lose control and roll or hit other cars. It's not always the initial impact that does all the damage.
Conveniently, your delta-v with this massive body you don't want to run into is also the one conventionally reported for your speed.