Anyone can give out loans. Having enough capital to give out tons of loans simultaneously, though, is yes a semi-unique feature of a bank.