> usure where to start and what the hardware requirements would be

Have a look at the localllama subreddit

In short though dual 3090 is common, single 4090 or various flavours of M123 macs. Alternatively p40 can be jury-rigged too but research that carefully. In fact anything with more than one gpu is going to require careful research