I have the same configuration and leave display scaling at 100%, but set the font scaling factor to 1.5 in the Gnome Tweak Tool. In this way, all fonts in Wayland and XWayland apps have the right size and nothing is blurry. Only controls like window borders are a bit smaller than intended by the designer, but I actually prefer it that way because it's more compact.