It makes sense that the banks started setting LIBOR. It's the rate they lend to each other. Sometime they borrow, sometimes they lend. In theory, everybody voting on a fair rate results in a fair rate.

BUT... Other people saw this rate which looked like a really convenient benchmark, and started using it as a benchmark. Now you have all the makings of a conflict of interest.