There are three types of money: central bank reserves, physical currency and commercial bank money. The U.S. government (Fed and Treasury, respectively) directly controls the first two down to the cent. Commercial banks "make" the final one, but to get the right to do that they have to agree to Federal Reserve jurisdiction (internationally, this happens with central banks entering into swap agreements with the Fed, i.e. opening "accounts" with the Fed into which the Fed deposits U.S. dollars whose--since this needs to be said--quantities it gets to track).
A common misconception, but incorrect [1]. The Federal Reserve was created by an act of the Congress in 1913 [2]. Part of the confusion arises from private banks holding "shares" in their respective regional reserve banks. These "shares" are less "share of stock" than "you are regulated by us" membership accounts with an archaic label.
The history you mention, of a private organization gradually falling under the purview of public regulation, is closer to that of the Bank of England's [3].
> who lend money to the US treasury at interest paid as dividends
American banks are required to hold a lot of their capital in safe assets, i.e. U.S. Treasuries and things that look like Treasuries. So yes, banks lend money to the government and then get back interest. If you'd like, you can do this too [4].
[1] https://www.frbsf.org/education/publications/doctor-econ/200...
[2] https://en.wikipedia.org/wiki/Federal_Reserve_Act
[3] http://www.intriguing-history.com/bank-of-england-history/
[4] https://www.treasurydirect.gov/indiv/research/indepth/tbills...