Export is well export "Take this project and make it <Foo> format with <Bar> quality" settings.
It's the way many print/graphics packages split it conceptually.
In GIMP, saving refers to persisting the project in the native .xcf format. Everything else is exporting.
Exporting loses information, that's why it's not called saving. It can use lossy compression, first of all. And then, the target format might not support all the semantics. For instance, it might not support layers, or not support layers with all their GIMP nuances, like layer masks and whatnot.
If you're working on a PNG or JPEG and want to close GIMP and continue later without any loss of data or disruption, you have to save the project as an .XCF.
Consider if someone "saved" into a format that does not actually support all the features of Gimp, like PNG. They might be surprised when they open their file and things like layers are missing.
GIMP's export is smart enough not to keep prompting you. You are prompted once to set the parameters, like compression and others. Then you can repeat the export operation with no prompting. You have a Ctrl-E hotkey to do that instantly, and Ctrl-S continues to save your project to the .xcf file.
I guess I would have expected this to be called “save”?