HN in general isn't aware of operationalization[1]. It's an interesting quirk of computer science being a STEM field, but CS research is qualitatively different from physics, sociology, psychology, biology, zoology, and ag science. Rather, the typical CS student has a pre-theoretical conceptualization of quantification and data collection as it pertains to research methodology.

Instead of relying on operationaluzation, the phenomena is considered strictly immeasurable. It leaves a lot on the table. In the examples above, for instance, there are a number of unsubstantiated assumptions as well as pros and cons that implicitly do not account for operationalization and it shows.

1. https://en.m.wikipedia.org/wiki/Operationalization