Maybe an e-dirt bike. Based on your preference of the ride of a bike over scooter, a dirt bike may be what you are looking for. The ones I have seen are built for actual tracks and off-road, but they might make some street legal versions or certainly you could install the light features and other equipment required to comply with your specific state law as many do with traditional gas powered dirt bikes.

Edit: I probably should have mentioned cost as the e-dirt bikes are not really in the same range as any scooter or e-bike I've come across.