I'm not sure these questions can be answered philosophically. After thousands of years, philosophy can't even agree on the the morality of things that already do exist.

Science fiction and moral philosophy depict "model organisms" as physical replicas of organic ones for a reason. Our moral ponderings are driven by moral feelings, and they need to trigger feelings for the reasoning to be interesting. The neocortex court only debates when limbic prosecutors press charges.

Ultimately, the task here is software that answer questions, not software that is a mouse. If software those two converge, we have a moral dilemma. Seems unlikely though.