Reading a conversation and deciding whether a chatbot wrote it can be surprisingly difficult. In a study involving more than 72,000 judgments of human and AI responses, participants frequently mistook machine-generated captions, word associations and conversational replies for human work. However, in a smaller experiment, direct questioning proved more successful at exposing a chatbot, though even that comes with caveats.
Mengmi Zhang of Nanyang Technological University in Singapore and colleagues report the findings in Nature Human Behaviour. Their central point is that being able to pass as human depends heavily on how the testing is conducted.
To read more, click here.