Do you mind sharing your qmk config? I'm using homerow for modifiers and combos for symbols, barely using any layers. Though idea of ditching homerow modifiers for layers not crazy since there is no arbitrary modifier need (cmd-c t etc can be thrown into a layer)