However, American's really don't like the idea of an overly powerful government watching over your shoulder. The idea that the government is supposedly using gathering this information and that it doesn't even have a legitimate use case is unappealing to most.
Many parents would rather that their children not visit the home of a friend that had guns in it. Would as many parents be apprehensive about sending their children to a home with a pool? I suspect not.
There may be legitimate reasons that they are treated differently in a way that does not immediately make sense when you examine the risks they pose, but I don't think that choice or lack of it is that reason. I think that you are looking for something more subtle.
I wouldn't leave my kids at any place that I felt was going to be a tangible danger to them - be that a house with a pool and a back door that doesn't have a child lock or pool gate, or a house of an irresponsible gun owner, or a house with exposed electrical wiring, or anything else that I feel poses a material threat to my child's life.
Most Americans haven't thought about it hard enough to make a meaningful personal decision and have allowed themselves to adopt the first external opinion they were offered, so it's about 50-50 pro-con on the question.
What you're doing, is giving yourself permission to not engage other people about the issue. "Oh, I don't need to talk to grandma, I'm sure she's already on my side."