@johncarlosbaez The popsci and PR understandings of the Turing Test have always driven me nuts. Turing was a mathematician, not a cognitive scientist. The brilliance of the Turing Test was the very idea of proposing a concrete, implementable test. To insist the first real attempt at designing an experiment is perfect is quite silly, and Turing would think so too if he were here today.
To me the most obvious issue is the human propensity to assign thought and meaning behind sentences. This was more obvious when Markov chains were a fun toy and they'd occasionally spit out things people quite enjoyed. It's useful to guess at the intended meaning behind words when conversing with another human, but that predisposition makes us liable to ascribe deeper meaning where there may be none. We didn't evolve to deal with linguistic parrots, and we're ill equipped for it. This makes language a poor medium for determining consciousness or intelligence of a nonhuman.