I think the point being made is that public admin software has to be complicated because the underlying laws, policies, regulations, and procedures are complicated. Sometimes, they are over-complicated. And, sometimes this is deliberate (e.g., if applying for benefits is too complicated, fewer people will complete the process).

If we elect politicians in favor of simplifying government operations, and they can actually succeed, then it follows that government software would naturally simplify as well.

Note: This isn't necessarily the same as reducing government's role.