I'm not sure this is an application where using AI makes sense. For example, there are a large number of algorithmic ways to determine if a number of probably prime -- https://en.wikipedia.org/wiki/Miller%E2%80%93Rabin_primality...