1 LAW EXTENSION COMMITTEE UNIVERSITY OF SYDNEY 2009 JURISPRUDENCE OUTLINE ALL STUDENTS PLEASE NOTE: The outline below is intended to assist students in following the lectures and in understanding the recommended reading. The outline is not a substitute for the lectures and reading. The outline is not intended to be comprehensive. Students who have merely familiarised themselves with the outline but not attended the lectures and read the prescribed text and readings will be inadequately prepared for the exam and at substantial risk of failure. Examination questions will ask students to apply the concepts and arguments taught in the course to an issue or problem. Students will be best prepared to deal with the paper who have attended the lectures or weekend schools and read widely. LECTURE 9 LEGAL REASONING ABOUT FACTS AND PROBABILITY THEORY Introduction Judges and lawyers spend more time reasoning about factual matters then legal matters and it is therefore important to see what light contemporary philosophy may shed on this process. The key legal concept regarding factual inquiry is the notion of judicial proof. This is presently represented, at least in part, by the definition of relevant evidence (s.55 Evidence Act) and the definition of standard proof (Evidence Act, s.140 civil standard, s.141 criminal standard, being the well known rule in civil cases that proof is on the balance of probabilities, and in criminal cases that the prosecution must prove the case beyond reasonable doubt). The usual definition of the civil standard and the definition of relevance both use the term “probability”. The concept of probability has been a key focus of philosophical inquiry for several centuries. Christopher Birch May 2009 2 Historical Background The mathematical calculus of probabilities was first developed by Blaise Pascal (1623-1662). Pascal developed the mathematics of chances as an axiomatic system in a correspondence with Fermat. This correspondence consisted of five letters exchanged in the Summer of 1654. Pascal’s Probability Theory is frequently taught within courses on statistics and the theory has been most often applied in calculating the likelihood of outcomes in regard to repeated events. (eg, dice or card games or in predicting the likelihood of certain properties being possessed by members of a population). These applications are frequently described as the frequentist interpretation of probability theory. Many considered puzzling the application of probability to unique events. What does it mean to say that the probability that the accused is guilty is 90% or the probability that the government will win the next election is 50%? In 1954 the mathematician LJ Savage in “The Foundations of Statistics” showed that meaning could be attached to questions about the probability of a unique event. Savage proposed that an individual choosing between competing theories chose as if deciding what wagers to make in a lottery in which the lottery outcomes represent the truth or falsity of the propositions. Savage was able to use rational choice theory to show that a unique number P(A) may be assigned to a proposition A and that the number so assigned would follow all the usual rules of conventional probabilities. This is sometimes referred to as the subjective interpretation of probability, since the probability assigned to the truth of an event represents the subjective judgment as to the likelihood of the event being true. Law and Probability Theory The law appears to incorporate and depend upon the concept of probability in a number of important respects. Apart from the concepts of proof the law has frequently applied probabilistic concepts to deal with the notion of proof in situations of risk or uncertainty, see in particular: TNT Management v Brooks (1979) 23 ALR 395 – uncertainty about the cause of an accident; Rose v Abbey Orchard Property Investments [1987] Australian Torts Reports 80-121 – uncertainty about whether a precaution would have prevented an accident; and Christopher Birch May 2009 3 Sellars v Adelaide Petroleum (1994) 179 CLR 332 – uncertainty about the amount of loss caused by a misrepresentation. Is all Legal Factual Reasoning Amenable to Mathematical Analysis? Mathematical probability as been used by courts in dealing with clear situations of uncertainty or risk, but do the rules that govern mathematical probabilities underlie all reasoning about factual matters. A major debate in the legal literature was triggered by the decision in People v Collins 68 Cal.dd.319, 438p.dd 33 66 cal.Rptr 497 (1969) (Enbanc) in which a Californian court initially permitted statistical evidence of the likelihood of an accused being the person identified, to be admitted as evidence of the improbability that the wrong person had been prosecuted. The decision was overturned on appeal at which it was shown that incorrect use had been made of statistical evidence. The case was the subject of an important article by Finklestein and Fairley – “A Bayesian Approach to Identification Evidence” in 83 Harvard Law Review, 498 (1970). The authors argued that the proper approach was the use of Bayes’ theorem to determine the revised probability of the guilt of the accused in the light of fresh evidence. Their article was followed by the now famous riposte by Lawrence Tribe - “Trial by Mathematics: Precision and Ritual in the Legal Process”, 84 Harvard Law Review, 1329 (1971). Bayes Theorem The theorem was discovered by Thomas Bayes (1702-1761). Bayes’ theorem is more readily applicable to subjective applications of probability theory such as unique events. Some have argued that all reasoning about facts should, to the extent that we are able, conform to the principles of the mathematical calculus of probabilities (eg, Robinson and Vignaux, “Probability – The Logic of the Law”, (1993), 13 Oxford Journal of Legal Studies, 547 at 462). On this view even though we may not as a matter of practice be able to explicitly calculate probabilities in accordance with the mathematical calculus we should seek to ensure that our usual rules and principles of inference are consistent with the mathematical calculus. Christopher Birch May 2009 4 The calculus may allow us to identify areas of faulty reasoning (eg, the alleged error of logic in the High Court judgment in Chamberlain v The Queen (No.2) (1984) 153 CLR 536). Criticisms of the Bayesian Approach Some scholars have argued that it is misconceived to model legal reasoning about facts on the mathematical calculus. The criticisms made by Lawrence Tribe were expanded and enlarged by L Jonathon Cohen in “The Probable and the Provable” (1977) which argued that legal reasoning is not based on the application of mathematical probabilism but is based upon a different form of probability called by Cohen “inductive probability”. Cohen relied upon several arguments and paradoxes to show why inference drawing in law is different from the mathematical process. The Gatecrasher Paradox If proof on the balance of probabilities was equivalent to proving something to an amount greater than .5 than plaintiffs should be entitled to win cases by adducing merely statistical evidence (eg, if there are 1,000 people in a stadium where only 499 have paid admission, anyone sued at random would be liable to judgment in the absence of other evidence). Because we would not accede to such proof Cohen argued that proof in law cannot simply be mathematical. (See also the blue and red bus company paradox). The Argument about Conjunction Where a legal action depends upon several independent elements, all of which must exist to establish liability, application of the mathematical calculus would require us to multiply the probabilities of each element. Where the probabilities are less than 1 (as will always be the case) the effect of multiplying them will be to produce a small overall probability, unless each had a very high initial probability. The law does not apply this rule but treats each matter as proven once it is established to be more likely than not. Cohen also argued that the rule of inference upon inference applied in Chamberlain v The Queen is in fact the correct principle and provides a protection against error. The Problem of Beyond Reasonable Doubt Christopher Birch May 2009 5 It is not clear what mathematical probability should correspond to a level of belief beyond reasonable doubt in the guilt of the accused. Figures such as .9 or .95 (allowing for a 10% or 5% likelihood of error) seem too low. Higher probabilities would appear to make the prosecution’s task too onerous. If the presumption of innocence be equated with a probability of zero then on any application of Bayes’ theorem the probability of the accused’s guilt will always come to zero. Criticisms by David Hodgson In his article “The Scales of Justice: Probability and Proof in Legal Fact Finding” (1995) ALJ 741 Hodgson argues that the mechanical application of the concepts of mathematical probability will produce wrong or unjust results where it is applied to an inadequate evidential basis. Further, the calculus of probabilities may not be of much assistance in determining what is an appropriate evidential basis. Conclusion – What Principles Ought to Guide Legal Reasoning? It is clear from Cohen’s many examples that legal reasoning does not comply with the calculus of mathematical probabilism. Some might suggest that this demonstrates the irrationality of the law. It may be that jurists consistently underestimate the probative weight of circumstantial evidence (as some American scholars have sought to show through empirical testing). That the law does not follow the mathematical calculus does not end the debate. It is telling that where we are concerned with risk and uncertainty in many other areas of life the mathematical calculus is relied upon in determining risk (eg, in risk analysis in major engineering projects, aircraft safety and the like). Given that we can never be absolutely certain of the guilt of an accused putting people in gaol is a risk taking activity, the rational method for gauging those risks may at least presumptively be one that complies with the method we apply in determining risks in other areas of life. Christopher Birch May 2009