I just use the Ikea trådfri dimmers[1] and have them bound to the lights I want them to control. That way they can do on/off and dim.

They no longer seem to offer them. But the replacement might work as well. Support for the device was merged into Z2M last month so not sure if it's already included in the latest release.

1. Predecesor of this: https://www.ikea.com/nl/en/p/somrig-shortcut-button-white-sm...