I have more than that on my ordinary consumer router and have never seen a problem. Worst case, it'd be straightforward to dedicate a Wi-Fi router to your smart devices in the same way that you have a hub (and possibly repeaters) for your Zigbee devices.