However, there are newer ones take care of that and regulate the voltage down to 1.1V or so shortly before they run completely out of juice, so that the battery indicator can give a warning. Don't know how widespread that feature is yet, but it exists.
For Lithium chemistry: https://data.energizer.com/pdfs/l91.pdf
That's Energizer's Lithium of course, but you can expect that competitors probably perform "similarly".
------
You can see that Energizer Lithium is 1.7V, slightly more than the 1.5V found in typical Alkaline cells. Today's electronics are pretty flexible however, and this may not be an issue. (In practice, AA-devices are usually designed for 1.35V NiMH, 1.5V Alkaline, and 1.7V... but there are some devices that have made 1.5V assumptions and _ONLY_ work with Alkaline)
The 1.5 V rechargeable lithium batteries couple a rechargeable lithium cell with a buck converter to drop the voltage to 1.5 V.
I haven't seen any that are sophisticated enough to use a variable output buck converter and drop the voltage as the underlying battery discharges.
With the battery presenting a constant voltage, wouldn't that make battery level displays useless? They rely on the voltage declining as the battery discharges. With a constant 1.5 V battery your device is going to say the battery is full right up until it suddenly stops.
I'd expect that to get very annoying.
Edit: I mean the 1.5 V lithium rechargeable AA batteries, like these: https://www.amazon.com/Deleepow-Rechargeable-Lithium-Batteri...