> you're making the same mistake: looking at behavior and affirming the consequent (namely: it outputs smart-looking text, therefore it must be intelligent)

Why is that a mistake? What other means do we have of assessing intelligence?