I don't know how you'd do useful public peer review. By definition, "peer" assumes some professional domain competence.
The current system is probably too restrictive, but it's hard to imagine a more open system that's at least as useful.
Maybe someone should do a PhD on it. :)
Heck, you can even create groups like "former reviewers of XXX journal" and as soon as you convince other people, gain reputation very quickly.
I would also make reviews public and name-and-shame any caught review fixing (if proper evidence is available), which would be the bigger problem imho. But again, I think this is something we should also be able to detect using proper algorithms. If a user Alice always rates the papers by Bob highly, even when others disagree, perhaps her opinion of Bob's work is not to trustworthy.
This is how some journals come to be more prestigious than others anyway. You don't restrict the creation of journals to verified people; instead everyone gets to run a journal and they compete for reputation.
OTOH, I do not like excluding users, but I think public read-access and write-access trough accredited universities and research groups would be a fair balance. (Note, I also think if there is a charge associated with this process we should charge relative to the users country. Subsidizing access for developing countries by charging more in developed countries. To reduce exclusions.)
Note that arXiv has features that many previous repositories did not have, such as easy access to the original TeX files.
Plus, a comment system for a repository of preprints sounds very useful to me -- you can have early birds (such as PhDs or very active scientists) comment on your paper even before you submit to a conference/journal, thus getting good advice for free.
Anyway, "it does not have it because it has not happened yet" is exactly my point, because I don't see why it cannot evolve into a publishing platform.