Emotional Test Oracles

An oracle is a heuristic principle or mechanism by which we may recognize a problem. Traditionally, discussion within testing about oracles has focused two references: (1) requirements specifications that provide us with the "correct" answer and (2) algorithms we execute to check our answers. Testing textbooks talk about identifying a bug by noting the differences between the actual results against those references. Yet high-quality software is not created by merely analyzing conformance to specifications or matching some algorithm. It is about satisfying-and not disappointing-the people who interact with the product every day. Michael Bolton introduces the idea that our emotional reactions to programs as we test them-frustration, confusion, annoyance, impatience, depression, boredom, irritation, curiosity, and amusement-are important triggers for noticing real problems that matter to real people. Take back a new way to use your own emotional test oracle to evaluate the software you are testing.

• Why an obsession with automation may cause us to miss important problems
• How our emotions can help us to recognize important problems
• A model for assessing subjective and emotional responses to software