Seeing how computers ‘think’ helps humans stump machines and reveals AI weaknesses

Researchers have figured out how to reliably create questions that challenge computers and reflect the complexity of human language through a human-computer collaboration, developing a dataset of more than 1,200 questions that, while easy for people to answer, stump the best computer answering systems today. The system that learns to master these questions will have a better understanding of language than any system currently in existence.