STAT 110 - Section 5 Lecture 27 Professor Hao Wang University of South Carolina Spring 2012 Hypothesis testing example 1 • James Bond insists that his martinis should be shaken, not stirred. A skeptical bartender tests Bond with 6 martinis (using six fair coin flip to determine which drinks to shake and which to stir). Bond errs on one and correctly identifies the other 5 before passing out. • Is this evidence sufficient to reject the null hypothesis that Bond cannot tell the difference and is merely guessing (i.e., his probability of correct identification p=0.5). To find out we test the null hypothesis H0: Bond is merely guessing versus alternative H1: Bond is not merely guessing. • Under the null hypothesis, what is the probability that Bond correctly identifies 5 or more out of the 6 martinis? Ans: 0.11 • Based on the answer to the above question, what is your conclusion about Bond’s ability to tell the difference at the significance level 5%? Chapter 22 – What is a Test of Significance • A hypothesis test checks sample data against a claim or assumption about the population. The claim or assumption being tested is called the null hypothesis such as: H0: p = 0.50 The null hypothesis is the status quo. It is always set up using an equal sign. The statement we are looking for evidence of is called the alternative hypothesis. Three possible alternate hypotheses for seeing if a coin was fair could be: 1) Ha: p < 0.50 or 2) Ha : p>0.50 or 3) Ha: p is not equal to 0.50 The alternative hypothesis is also called the experimental hypothesis. It is opposed to the null hypothesis. The p-value is used to summarize the amount of evidence we have against the null hypothesis. The p-value is the probability that we would see a statistic at least as extreme as the one observed if the null hypothesis was true. The smaller the p-value, the more evidence against the null hypothesis. The Level of significance ( a ) determines how much evidence against H0 we require to reject H0 and find in favor of the alternative hypothesis, Ha. If the p-value is less than a then we have statistically significant evidence against the null hypothesis. If the null hypothesis was really true, then the probability that you reject the null hypothesis is equal to a. So you should pick a to be the chance you are willing to take of rejecting H0 when it is really true. We can either: • Reject the null hypothesis and conclude the alternate is true. • Fail to reject the null hypothesis and not have enough evidence to say it is false. We never get to accept the null hypothesis and say that it is true! Example • A new drug is advertised as being 80% effective. A consumer advocacy group thinks that it isn’t that effective and is looking for evidence that it doesn’t work well. • What is the null hypothesis? • What is the alternate hypothesis? • Historically, 76% of students in an introductory psychology course have correctly answered the professor’s favorite test question on Freud. This semester the professor gave a randomly selected group of students an extra lecture on the subject and wants to see if it will help them do better on the question. • The null hypothesis (H0) should be: A) p < 0.76 D) p=0.76 B) p ≠ 0.76 E) p<0.24 C) p > 0.76 • Historically, 76% of students in an introductory psychology course have correctly answered the professor’s favorite test question on Freud. This semester the professor gave a randomly selected group of students an extra lecture on the subject and wants to see if it will help them do better on the question. • The alternate hypothesis (HA) should be: A) p < 0.76 D) p=0.76 B) p ≠ 0.76 E) p<0.24 C) p > 0.76 McDonalds claims their quarter-pounders weigh 0.25 pounds. A disgruntled customer thinks they’re being swindled and that they don’t weigh that much and wants to find out. The null hypothesis (H0) for testing this would be: A) m < 0.25 lbs. B) x = 0.25 lbs. x ≥ 0.25 lbs. E) x ≠ 0.25 lbs. D) C) m = 0.25 lbs. Recall that x is the mean of the sample. m (pronounced mu) is the symbol used for the mean of the population. McDonalds claims their quarter-pounders weigh 0.25 pounds. A disgruntled customer thinks they’re being swindled and that they don’t weigh that much and wants to find out. The alternate hypothesis (HA) for testing this would be: A) m < 0.25 lbs. D) m ≥ 0.25 lbs. B) m = 0.25 lbs. E) m ≠ 0.25 lbs. C) m > 0.25 lbs. A random sample of 100 quarter-pounders was weighed in order to test the null hypothesis H0: m=0.25 against the alternate hypothesis HA: m<0.25 . The average weight of the 100 burgers was 0.249 lbs. and the p-value was 0.1752. If a=0.05 we would A) Reject the null hypothesis and conclude the burgers were too light. B) Accept the null hypothesis and conclude the burgers weighed 0.25 lbs. on average. C) Conclude that we do not have enough evidence to say the burgers are too light. A random sample of 100 quarter-pounders was weighed in order to test the null hypothesis H0: m=0.25 against the alternate hypothesis HA: m<0.25 . The average weight of the 100 burgers was 0.231 lbs. and the p-value was 0.03851. If a=0.05 we would A) Reject the null hypothesis and conclude the burgers were too light. B) Accept the null hypothesis and conclude the burgers weighed 0.25 lbs. on average. C) Conclude that we do not have enough evidence to say the burgers are too light. McDonalds claims their quarter-pounders weigh 0.25 pounds. The manager thinks that the employees are wasting meat and making them too heavy. The alternative hypothesis (HA) for testing this would be that average weight (called m) is: A) m < 0.25 lbs. D) m ≤ 0.25 lbs. B) m = 0.25 lbs. E) m ≠ 0.25 lbs. C) m > 0.25 lbs. Identify the null hypothesis (HO) : a. No change in VOD b. Reduction in VOD c. Increase in VOD Identify the alternative hypothesis (HA) : a. No change in VOD b. Reduction in VOD Increase in VOD c. At what α-level would you be able to reject the null hypothesis using the circled p-value? A) ® =0.01 B) ® =0.05 C) ® =0.10 It is important to pick a in advance, before you get your p-value. Otherwise you could just pick your a later so that you could reject the null hypothesis only if you wanted to! In this case drug companies could always claim that their drug worked! “Hmmm… my p-value was 0.078, so I’ll pick a to be 0.08 so that I can reject H0!” A pharmaceutical company is trying to show that their new product increases the effectiveness of antihistamines in fighting allergies. In a sample of 25,000 allergy sufferers, half were given just the antihistamine, and the other half were given both the antihistamine and the new product. The extra percent experiencing relief when they took both drugs is the variable measured. What is the null hypothesis: a) H0: extra percent of all patients < 0 b) H0: extra percent of all patients = 0 c) H0: extra percent for the sample = 0 d) H0: extra percent for the sample > 0 A pharmaceutical company is trying to show that their new product increases the effectiveness of antihistamines in fighting allergies. In a sample of 25,000 allergy sufferers, half were given just the antihistamine, and the other half were given both the antihistamine and the new product. The extra percent experiencing relief when they took both drugs is the variable measured. What is the alternate hypothesis: a) HA: extra percent of all patients < 0 b) HA: extra percent of all patients = 0 c) HA: extra percent for the sample = 0 d) HA: extra percent for the sample > 0 e) HA: extra percent of all patients > 0 Of the 12,500 receiving just the antihistamine, 62% experienced relief. Of the 12,500 receiving both the antihistamine and the new product, 63.1% experienced relief. The p-value for this test was 0.037. If a=0.05 we would: a) Fail to reject the null hypothesis and conclude that the new product did provide extra relief. b) Fail to reject the null hypothesis and conclude that we did not have enough evidence to say there’s a difference. c) Reject the null hypothesis and conclude that the new product did new product did provide extra relief. d) Reject the null hypothesis and conclude that we don’t have enough evidence of to say there’s a difference.