Why though? Naively it would be possible to bundle postgres and have your app connect on localhost. What would be wrong with doing that?

You could do it, but you'd be paying (in complexity, resource use, and bundle size) for a bunch of features and optimizations you don't need, and it'd be tuned for a totally different use case than occasional access by one local process.