You can arbitrarily reorder your photostream (not just sets, your actual photostream), and you can check the organizer to filter your photostream for only public photos.
http://flickrstream.webzardry.com/
The key is "upload date" which is editable, and determines the order.
If you don't have a tool for it, go to your set in the organizer, sort the set as you want, go to the first photo, open the edit modal dialog, and start stepping through the photos setting the upload time to 1 second after the last. When you're done, the photo stream itself will reflect the custom order.
Sets already reflect your custom order with no extra work. Some Flickr tools (of which there are hundreds) support reordering the photo stream, using this technique under the hood.
Since everything on Flickr has an API, you can do most anything you can imagine.
Unfortunately they have this bizarre concept of a photostream in which you cannot rearrange the order of photos, and they happen in the order of upload and not the date on which they were taken.
Also, while logged in, you cannot filter your own photostream by public / family-only / private photos only. It can be quite annoying, since I have thousands of family-only photos and only dozens of public photos, so I have to log out to see how my photostream looks to outsiders.