Ultralights have very strict restrictions and rules where they can be operated, to limit the risk to others.

14 CFR 103.15: "No person may operate an ultralight vehicle over any congested area of a city, town, or settlement, or over any open air assembly of persons."

Also, you don’t need a license, but trying to fly without sufficient and proper training is likely to get you killed. These aren’t bicycles.