Banks who petition the Fed for FDIC insurance face much stricter reporting rules, capital reserve requirements, and limits on the riskiness investments they can make with client deposits from FINRA and the SEC. If you wanted, you could view the lack of FDIC insurance as a sign of a riskier institution overall, but like any other investment it might be worth it for the higher rate.