Improspectives

The folk wisdom that “bad things come in threes” is still popular in the U.S. Whenever two celebrities die on the same day, for example, even the most hardened critical thinker feels the urge to look for the third.

Is clustering real? Do events happen in streaks, or are they just a product of our pattern-seeking brains?  George Carlin made fun of the “bad things happen in threes” adage by stating that bad things actually happen in 27’s, noting that “it just takes longer to see the pattern.” You can always find instances of “bad things” in the world to fill out your sets of three, but what does the research say? There have been a lot of studies on the subject, including Koehler and Conley’s “The “Hot Hand” Myth In Professional Basketball”, published in 2003 in the Journal of Sport and Exercise Psychology. The authors examined the National Basketball Association’s long distance shooting contest and looked for statistical aberrations in the sequences of made and missed shots. As in all but a few other studies, they found no significant deviation from chance. When they took each player’s base shooting accuracy into account, the effect disappeared.

Sports are physical contests and even little variations in physical conditions can affect performance, but what about chess? Chess is a mental game played with perfect information. That is, you know everything there is to know about a position and there’s no hidden information, such as a player’s hole cards in poker. As of this writing, I have played 19,738 games of blitz chess (each player has 3 or 5 minutes to make all moves in a game) at the Internet Chess Club since June 27, 2001. As I watch my online chess rating fluctuate from embarrassing to “not bad for me”, I wonder how much the streaks of wins, losses, and draws reflect my abilities and how much is the “luck” of an opponent making some horrible mistake.

The three-year graph of my rating shows huge swings, but the average is right about where I perceive myself as a player. Perhaps my streaks are due to luck. After all, I don’t seriously study the game and play to take a break from other work. The big changes make a strong visual impression, but there are a lot of small shifts in there, too.

Improvisers can make a fun game out of looking for apparent patterns and justifying reasons for believing streaks exist. The lesson for analysts? Carefully examine whether a sequence of events is due to some underlying cause or is just a sequence of events that might be due to chance. That said, given the strength of our innate need to discover patterns, is there any way to dispel what appears to be the myth of the hot hand? In a 2006 review of the literature, Michael Bar-Elia, Simcha Avugosa, and Markus Raab summarized the situation in this way:

As Amos Tversky, who initiated the hot hand research, used to say (cited by Gilovich in an online chat, September, 2002), ‘‘I’ve been in a thousand arguments over this topic, won them all, but convinced no one’’.