well these days inference can be done on CPUs depending on the size of a model. the OAK-D camera's especially are literally just computer. They are linux and you can SSH directly into them which is insane. The camera itself is shaped like a heat sink to dissipate heat. it's honestly phenomenal. I talked to the CEO of the company as well and I'm really impressed with their machine and supply chain. so all in all, high hopes for them.