It is both irrelevant and the underlying foundation for the whole hype train.
... the algorithms and the pre-filtering of the training set, however large the latter may be.
The Artifishy Intelligence marketing pump has many hands drawing water by the bucket.
If you don't like it, don't use it.
My problem starts when you make bold claims like "LLMs can self reflect" and your only evidence is "I asked one and it said yes".
No, that's the problem. You don't have certainty, not in any remotely scientific definition of the word, because you don't have enough data, and the data you do have is crap.
Also:
> I see no evidence that they can't self reflect
I see no evidence that there isn't a magical invisible unicorn in the sky that grants wishes to those who wear unicorn themed underwear, so, it must exist.
I don't even know enough superlatives to express how irrelevant it is that "it seems to you" that an LLM behaves this way or that.
And even the "protocol" in question is weak. Self reported data is not that trustworthy even with humans, and arguably there's a much stronger base of evidence to support the assumption that we can self-reflect.
In conclusion: please, stop.