The Prisoner's Dilemma

By Leon Felkins, written 9/5/95

Revised on 3/12/01

The "Prisoner's Dilemma" game has been extensively discussed in both the public and academic press. Thousands of articles and many books have been written about this disturbing game and its apparent representation of many problems of society. The origin of the game is attributed to Merrill Flood and Melvin Dresher. I quote from the Stanford Encyclopedia of Philosophy:
Puzzles with this structure were devised and discussed by Merrill Flood and Melvin Dresher in 1950, as part of the Rand Corporationís investigations into game theory (which Rand pursued because of possible applications to global nuclear strategy). The title "prisonerís dilemma" and the version with prison sentences as payoffs are due to Albert Tucker, who wanted to make Flood and Dresherís ideas more accessible to an audience of Stanford psychologists.
The Prisoner's Dilemma is a short parable about two prisoners who are individually offered a chance to rat on each other for which the "ratter" would receive a lighter sentence and the "rattee" would receive a harsher sentence. The problem results from the fact that both can play this game -- that is, defect -- and if both do, then both do worse than they would had they both kept silent. This peculiar parable serves as a model of cooperation between two or more individuals (or corporations or countries) in ordinary life in that in many cases each individual would be personally better off not cooperating (defecting) on the other.

General Model of the Two player Game

The Prisoner's Dilemma model as presented by Robert Axelrod, Douglas Hofstadter, and others (See References), goes as follows:

Two prisoners, lets call them Joe and Sam, are being held for trial. They are being held in separate cells with no means of communication. The prosecutor offers each of them a deal. He also disclosed to each that the deal was made to the other. The deal he offered is this:

Put yourself in Joe's position. If Sam stays mum and you sing, you get zero years. If he stays mum and you stay mum, you will each get 2 years. On the other hand if both of you confess, you both get 4 years. Finally, if he confesses and you don't, you will get 5 years. Whatever Sam does, it is to your advantage to admit your wrong doing. Of course, Sam is also a rational person and he will, therefore, come to the same conclusion. So you both end up confessing which nets a total of 8 man-years in the pokey. The paradox is, if you had both denied the crime, a total of only 4 man-years would be spent behind bars. Wait a minute! Can it really be that rationality leads to an inferior result? Let's look at this one more time. We will use a payoff matrix, a common tool of the game theoreticians. The payoff matrix is usually presented in the following form:
      ACTION                        PAYOFF
  Joe       Sam               Joe        Sam
 Cooperate  Cooperate         -2 (R)     -2 (R)
 Cooperate  Defect            -5 (S)      0 (T)
 Defect     Cooperate          0 (T)     -5 (S)
 Defect     Defect            -4 (P)     -4 (P)
 
 (The codes represent standard terminology for each action:
 
     R       Reward for mutual cooperation
     S       Sucker's payoff
     T       Temptation to defect
     P       Punishment for mutual defection                 )
 

The general form of the Prisoner's Dilemma model is that the preference ranking of the four payoffs be, from best to worst, T, R, P, S and that R be greater than the average of T and S. That is, any situation that meets these conditions will be a "Prisoner's Dilemma".

In summary, the Prisoner's Dilemma model postulates a condition in which the rational action of each individual is to not cooperate (that is, to defect), yet, if both parties act rationally, each party's reward is less that it would have been if both acted irrationally and cooperated!

The model can be applied to many real world situations, from genetics to business transactions to international politics.

Iterated "Prisoner's Dilemma" with multiple participants

If the game is played only once there is no incentive for either player to do anything but defect, as discussed above. In fact, if the game is to be played a known number of rounds, there is no better choice than to defect. (Why? Because you both know you will defect on the last move. So, scratch off the last move. That puts you in the same situation for the next to the last move - and so on for all.) But if the game is to be played an indefinite number of times, under certain conditions, cooperation can evolve as the best policy.

Another addition to the game that makes it more realistic is to assume that each player interacts with a multitude of other players. Additionally, it can be assumed that each player remembers the past history of the interactions with each of the other players and that past history is the only information he has.

The Iterated "Prisoner's Dilemma" has been the subject of much study and computer simulation (see references). An interesting and possibly useful result of these studies is that a player's best strategy in this "game" is "Tit for Tat", with the additional proviso that the player be initially cooperative. That is, "I'll start off being nice but from that point on, whatever you do to me, I will do to you on the next interaction". This strategy has been shown to be clearly more productive than "The Golden Rule"!

Note that we are discussing multiple participants in which activities are between pairs of "actors". There is yet another more complex situation in which an individual is interacting with ALL of the other participants at once. This situation, which is more common in the real world, is called the "Many- person-dilemma" or, in my terminology, the "Voter's Paradox". See the companion essay, "Voter's Paradox" at this and other sites.

A new book that provides much greater insight into the Prisoner's Dilemma and the possibility of cooperation is The Origins of Virtue by Matt Ridley (see the references). Matt presents the idea that cooperation between humans may have evolved in spite of the "rationality" of defection. That is, we may be more like ants than we would like to admit!

Related Game Scenarios

The Prisoner's Dilemma structure is a subset of the general paradoxical phenomena called "Social Dilemmas". Whenever an individual interacts with a group (which can consist of as few as 2 people, i.e. the Prisoner's Dilemma) dilemmas generally arise that have the characteristics of the Prisoner's Dilemma (that is, a "rational" action will produce an inferior result). By varying the payoff's of the 2 person game, several other interesting games evolve, some of which have useful application. For example, if the winnings are set such that T > R > S > P we get the game of "Chicken" which is representative of several real world situations.

For further study on the Prisoner's Dilemma, consult the references given below.

Author: Leon Felkins
Email: leonf@perspicuity.net


References:
  1. Axelrod, Robert. 1984. The Evolution of Cooperation. New York: Basic Books. A sample of his work is on the internet at this site.
  2. Hofstadter, Douglas R. 1983, "Metamagical Themas: Computer Tournaments of the Prisoner's Dilemma Suggest How Cooperation Evolves". Scientific American 248 (no.5):16-26.
  3. On the Internet: http://pespmc1.vub.ac.be/PRISDIL.html or click here. Author: F.Heylighen. Date: Apr 13, 1995 (modified)
  4. See the PARC papers on Dynamics for some simulation results
  5. For an introduction to Game theory, check out Al Roth's Game Theory and Experimental Economics Page
  6. Related games ("Game of Chicken", etc.) are briefly discussed in "CURRENT RESEARCH IN SOCIAL PSYCHOLOGY"
  7. Ridley, Matt. 1996. The Origins of Virtue. New York: Viking.
  8. A non-technical, easy to read book: Murnighan, J. Keith. 1992. Bargaining Games. New York: William Morrow and Co. (A chapter is on line here)
  9. Taylor, Michael. The Possibility of Cooperation, 1987, Cambridge.
  10. Several other essays are on the Internet. You can look at the Constitution site for several references or just do a search on "Prisoner's Dilemma".
Back to my home page.