We will do some more internal discussion on whether or not we want it to be the tool to provide emergency assistance. I'm not sure that's ethical. We have a team member with a decade of child education experience, but we can consider other advisors.
I don’t think it should provide emergency assistance, but I do think it should tell the child to call their emergency number or a trusted adult - not just tell them it can’t help.
Why do you think children shouldn't get answers to questions about human anatomy?
A reasonable and responsible approach could be to instruct the child to seek a safe adult around them to discuss any material that may be harmful.
> Try searching on X.com for strings like "Charlie Kirk assassination" or "Charlie Kirk shot dead video"
I don’t have any confidence you’ve done the due diligence to properly handle content moderation here - it seems very haphazard and poorly thought out. It would be incredibly unethical to market this for use by children right now.
If this is an important project for you, I strongly recommend you bring on an advisor with history in child safety and education experience and make them a core part of your development. You might also consider working with a university that has a good developmental psychology program - they often do a lot of supervised research of children’s habits and could provide valuable insight.