I'm playing on the older Xbox One X (series X still impossible to find), but my experience is roughly the same.

It's buggy, there are sometimes crashes/game breaking bugs, but the autosave makes recovery easy. The world and story are really good and make up for it.