Floridian’s Awareness of Separation of Power in the United States’ Government Prepared for: The Florida Bar Draft Report January 10, 2006 1 Table of Contents Study Objectives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Overview of Methodology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 Summary of Key Findings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Detailed Findings . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Demographics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Detailed Methodology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 2 Study Objectives The Florida Bar commissioned Harris Interactive to conduct a research project to gain insight into how well adults from Florida perceive and comprehend civic issues. The survey questions are designed to measure a few guiding principles in the structure of the U.S. government. Specifically, this research focused on the following topics: - Branches of government; Separation of powers; Checks and balances; and, Independent judiciary. Data from this study will be compared to results from the July 2005 American Bar Association’s national survey exploring the same concepts. 3 Overview of Methodology All interviews were conducted by telephone using an unrestricted Random Digit Dialing (RDD) technique that significantly reduces serial bias and ensures that respondents with both listed and unlisted numbers are reached. Only one interview was conducted per household. Florida Sample -Sample includes a representative sample of 400 Florida residents aged 18 or older. Interviewing was conducted between December 27 and 29, 2005. -The interview averaged 7 minutes in length. National Sample -Interviews of 1,002 U.S. adults were conducted on behalf of the American Bar Association between July 22 and 27, 2005. 4 Summary of Key Findings 5 Summary of Key Findings The majority of Florida and U.S. adults are only aware of some of the basic structures of the U.S. government. Only slightly more than half of Floridians and the national sample could correctly identify the three branches of government correctly, leaving pluralities who cannot. While vast majorities of Floridians (91%) can answer at least one of the division of powers questions correctly, only one quarter (25%) and slightly less Americans as a whole (21%) were able to answer all four correctly. Nearly one in five Florida residents (18%) believe the three branches of government are “local, state and federal.” As a close third, 16% of Florida adults select “Republican, Democrat and Independent” as the correct answer. Of Florida adults with a college education or more, nearly eight in ten (79%) correctly identified the three branches of government. Even more Americans (87%) selected the correct answer. Despite high levels of reported familiarity with the concept of separation of power, less than half of the Florida and national populations could correctly identify the meaning of the concept. Less than half (46%) of Florida adults and Americans as a whole (45%) can correctly identify the meaning of the concept of separation of powers. Among those least likely to identify the meaning of separation of powers were young adults (1834), adults with a high school education or less and those who are not married. Of those who report they are very or somewhat familiar with the concept of separation of powers, only 54% can correctly identify the meaning of the concept. 90% of Floridians and slightly less adults from the national sample (82%) feel that the separation of powers is important, while only 2% of Floridians and 5% of U.S. adults report that it is not important or they do not know what it means. 6 Summary of Key Findings The vast majority of Florida adults (93%) indicate that the concept of checks and balances is important, but only less than two thirds (64%) can correctly identify the meaning of the concept. Just about three quarters of Florida adults (72%) and slightly less adults nationally (68%) report being very or somewhat familiar with the concept of checks and balances. Florida adults 55+ had the most trouble identifying the meaning of checks and balances with only 58% indicating the correct response. Of Florida residents between the ages of 35-54, nearly eight in ten answered correctly. With only one quarter of Florida’s population answering incorrectly, more Florida respondents were able to correctly identify the meaning of independent judiciary as compared to the other government structure terms. Just over one in ten adults (12%) believe independent judiciary means “judges are not Republicans or Democrats.” More than seven in ten Florida adults who were married (74%), employed (75%) or education with a college degree or more (84%) could identify this term. 7 Detailed Findings 8 Less than six in ten adults in Florida and across the country can correctly identify the three branches of government. Branches of Government Florida vs. National Legislative, executive, and judicial 59% 55% 18% Local, state and federal 16% Republican, Democrat and Independent State, national, and international Not sure/Decline to answer (v) 16% 22% Correct Response: Florida: 59% National: 55% Incorrect Response: Florida: 37% National: 40% 3% 3% 4% 5% Florida National 9 Q411: What are the three branches of government? Base: All adults Florida (n=400), All adults National (n=1002) Florida adults who are men, employed, have at least a college education, are married and fall between the ages of 35 and 54 are significantly more likely than the overall population of Florida to correctly identify the three branches of government; national results mirror this demographic pattern. Branches of Government – Demographic Profile Gender Education Employment Age Marital Status Total Men Women High school or less Some college College or more Employed Not employed 18-34 35-54 55+ Married Not married % % % % % % % % % % % % % Florida Correct Incorrect 59 37 66 31 53 42 41 55 69 24 79 19 64 29 52 47 56 39 67 27 53 45 64 32 51 44 Correct Incorrect 55 40 60 37 51 43 33 60 62 35 87 12 66 32 44 48 57 38 57 40 53 41 63 33 46 49 National Q411: What are the three branches of government? Base: Florida: All adults (n=400), Men (n=192), Women (n=208), High school or less (n=86*), Some college (n=137), College or more (n=177), Employed (n=224), Not employed (n=175), 18-34 (n=72*), 35-54 (n=135), 55+ (n=192), Married (n=255), Not Married (n=141); National: All adults (n=1002), Men (n=483), Women (n=519), High school or less (n=273), Some college (n=310), College or more (n=416), Employed (n=582), Not employed (n=415), 18-34 (n=197), 35-54 (n=386), 55+ (n=409), Married (n=601), Not Married (n=394) 10 Similar numbers of adults from Florida (67%) and the entire U.S. (63%) indicate familiarity with the concept of separation of powers. Familiarity with U.S. Constitution Separation of Powers 20% 21% Very familiar 47% 42% Somewhat familiar 19% 20% Not very familiar 14% 16% Not familiar at all Not sure/Decline to answer (v) Total Familiar Florida: 67% National: 63% Total Not Familiar Florida: 33% National: 36% 1% Florida National Q415_1: How familiar would you say you are with these concepts on which the U.S. constitution is structured- very familiar, somewhat familiar, not very familiar, or not at all familiar? Base: All adults Florida (n=400), All adults National (n=1002) 11 The vast majority of Floridians (90%) feel the concept of separation of powers is important, somewhat more than adults nationally (82%). Importance of Separation of Powers 71% 61% Very important 19% 21% Important 8% 13% Somewhat important Not important 1% 3% Not sure what it means 1% 2% Not sure/Decline to answer (v) Total Important Florida: 90% National: 82% Not Important/ Not Sure What it Means Florida: 2% National: 5% 1% Florida National 12 Q425: How important is the principle of “separation of powers” in the federal government? Base: All adults Florida (n=400), All adults National (n=1002) Nearly half (46%) of Florida respondents and U.S. adults (45%) correctly identified the meaning of separation of powers. Of those who are very or somewhat familiar with separation of powers, 54% answered correctly. Meaning of Separation of Powers Florida National % % Congress, the President and the Federal Courts each have different responsibilities. 46 45 Different federal departments have different powers. For example, the Department of Defense runs the military while the Department of Justice prosecutes crimes. 29 27 The federal government does some things, like set postage rates, while state governments have other powers, like setting speed limits on state highways. 15 15 Republicans can do some things, but Democrats can do others. 4 6 Not sure/Decline to answer (v) 7 8 Of Floridians who reported they were very or somewhat familiar with “separation of powers,” 44% answered incorrectly. Correct Response: Florida: 46% National: 45% Incorrect Response: Florida: 47% National: 48% Of Floridians who reported they were very or somewhat familiar with “separation of powers,” 54% answered correctly. 13 Q420: Which of the following best describes what “separation of powers” means? Base: Florida: All adults (n=400), Answered separation of powers correctly (n=218), Very or somewhat familiar with separation of powers (n=311) Adults 35+ are about 1.5 times more likely than young adults (18-34) to identify the meaning of separation of powers correctly. Unlike the rest of the civic questions, unemployed Floridians were more likely than their employed counterparts to answer correctly. Separation of Powers – Demographic Profile Gender Education Employment Age Marital Status Total Men Women High school or less Some college College or more Employed Not employed 18-34 35-54 55+ Married Not married % % % % % % % % % % % % % Florida Correct Incorrect 46 47 49 45 44 49 39 51 50 43 56 44 42 53 52 39 34 56 50 47 52 40 50 45 40 50 Correct Incorrect 45 48 48 47 42 48 32 61 50 45 61 39 50 48 39 48 35 61 47 49 48 40 51 44 37 51 National Q420: Which of the following best describes what “separation of powers” means? Base: Florida: All adults (n=400), Men (n=192), Women (n=208), High school or less (n=86*), Some college (n=137), College or more (n=177), Employed (n=224), Not employed (n=175), 18-34 (n=72*), 35-54 (n=135), 55+ (n=192), Married (n=255), Not Married (n=141); National: All adults (n=1002), Men (n=483), Women (n=519), High school or less (n=273), Some college (n=310), College or more (n=416), Employed (n=582), Not employed (n=415), 18-34 (n=197), 35-54 (n=386), 55+ (n=409), Married (n=601), Not Married (n=394) 14 The majority of Florida (72%) and national (68%) adults also report that they are familiar with the concept of checks and balances. Familiarity with U.S. Constitution Checks and Balances 24% 23% Very familiar 48% 45% Somewhat familiar 15% 19% Not very familiar Not familiar at all 13% 13% Total Familiar Florida: 72% National: 68% Total Not Familiar Florida: 28% National: 32% Not sure/Decline to answer (v) Florida National Q415_2: How familiar would you say you are with these concepts on which the U.S. constitution is structured- very familiar, somewhat familiar, not very familiar, or not at all familiar? Base: All adults Florida (n=400), All adults National (n=1002) 15 Nearly all Florida residents (93%) and Americans as a whole (86%) feel the concept of checks and balances is important, with more than two thirds citing this concept as very important. Importance of Checks and Balances 76% Very important 69% 17% 17% Important Somewhat important Not important Total Important Florida: 93% National: 86% 3% 11% 2% 2% Not sure what it means 1% 1% Not sure/Decline to answer (v) 1% Not Important/ Not Sure What it Means Florida: 3% National: 3% Florida National 16 Q435: How important is the principle of “checks and balances” in the federal government? Base: All adults (n=), All adults National (n=1002) When it comes to checks and balances, about six in ten Florida adults (61%) can correctly identify the meaning, compared to less than half (46%) who correctly identified the meaning of separation of powers. Meaning of Checks and Balances Florida National % % A division of power among the branches of federal government that prevents any one of them from going beyond their constitutional authority. 61 64 Negotiations between Congress and the President over a balanced federal budget. 17 15 The decisions by the Federal Reserve Board about interest rates and banking. 10 8 Regulation of auditors and the financial services industry by the Securities and Exchange Commission. 7 6 Not sure/Decline to answer (v) 5 6 Most Likely to Answer Incorrectly 55+: 38% High school education or less: 49% Unemployed: 42% Correct Response: Florida: 61% National: 64% Incorrect Response: Florida: 33% National: 29% Most Likely to Answer Correctly 35-54: 79% College education or higher: 84% Employed: 70% Q430: Which of the following best describes what “checks and balances” refers to? Base: All adults (n=400), High school or less (n=86*), College or more (n=177), Employed (n=224), Not employed (n=175), 35-54 (n=135), 55+ (n=192); All adults National (n=1002) 17 Nearly three-quarters of Florida adults (72%) were able to correctly identify the meaning of an independent judiciary. Meaning of Independent Judiciary Florida % Judges are fair, impartial and free from political influence. 72 Judges are not Republicans or Democrats. 12 Judges can make decisions based on what they personally believe. 7 Judges can make or change laws from the bench. 6 Not sure/Decline to answer (v) 3 Most Likely to Answer Incorrectly 18-34: 39% High school education or less: 32% Unemployed: 31% Correct Response: Florida: 72% Incorrect Response: Florida: 25% Most Likely to Answer Correctly 35-54: 79% College education or higher: 84% Employed: 75% Q440: I’m going to read you a list of several phrases that might describe what it means to have an independent judiciary. Which do you think best describes what is meant by the term “independent judiciary?” Base: All adults (n=400), High school or less (n=86*), College or more (n=177), Employed (n=224), Not employed (n=175), 35-54 (n=135), 55+ (n=192); All adults National (n=1002) 18 One quarter of Floridians and slightly less U.S. adults (21%) can correctly answer all four questions about the U.S. government’s separation of powers. Summary of Correct Answers 27% 22% 19% 20% 22% 25% 21% 21% 14% 9% Answered 0 questions correctly Answered 1 question correctly Florida Answered 2 questions correctly Answered 3 questions correctly Answered 4 questions correctly National 19 Q411/Q420/Q430/Q440 – Summary of Correct Answers Base: All Florida respondents (n=400), All National respondents (n=1,002) Respondent Profile 20 Respondent Profile Gender Male Female Florida National Total Total % % 48 52 Children <18 in Florida Household Total % 48 52 Marital Status Married Single, never married Divorced Separated Widowed Living with partner Yes No National Total % 35 65 Florida Total % National Total % 59 21 9 3 7 * 55 19 13 2 10 * 38 25 Race White Black/African American Asian/Asian American Other Decline to answer Age Under 35 35 – 54 55+ Florida Total % National Total % 28 35 37 22 37 41 Florida Total % National Total % 67 12 1 2 2 73 12 1 6 2 16 84 10 90 Ethnicity Yes, of Hispanic origin No, not of Hispanic origin 21 Respondent Profile (continued) Education Florida Total % National Total % 45 29 26 43 33 24 High school graduate or less Some college College graduate or more Employment Status Employed full-time Employed part-time Not employed Florida Total % National Total % 49 8 43 41 10 48 Household Income Less than $25,000 $25,000 - $49,999 $50,000 - $79,999 $80,000 or more Decline to answer Florida Total % National Total % 21 24 19 23 12 33 27 17 12 12 22 Detailed Methodology 23 Detailed Methodology Harris Interactive conducted this telephone study. The company is the 13th largest and the fastest-growing market research firm in the world, most widely known for The Harris Poll® and for its pioneering leadership in the online market research industry. Long recognized by its clients for delivering insights that enable confident business decisions, the Company blends the science of innovative research with the art of strategic consulting to deliver knowledge that leads to measurable and enduring value. The Separation of Powers Survey was conducted by telephone with a representative sample of 400 Florida adults who are 18 years or older. Telephone interviews were conducted between December 27 and 29, 2005. Telephone Interviewing Procedures Telephone interviews averaged 7 minutes in length. Screening and interviewing for the study was conducted by Harris’ large, professional interviewing staff. Interviewing was regularly quality-monitored by Harris’ field supervisory staff. Telephone Sample Selection The telephone sample used a stratified sampling process designed to produce representative samples of persons in telephone households in Florida. The sampling procedure ensures equal representation of persons in both households which are "listed" in telephone directories, as well as persons in households which are "unlisted”. 24 Detailed Methodology CATI System Used in Telephone Interviews The Harris computer-assisted telephone interviewing (CATI) system permitted on-line data entry and on-line data editing of the telephone interviews. This system controls complicated skip patterns based on individual responses during the course of the interview, and it allows consistency checks to be built in for key items. Furthermore, it reduced clerical error by eliminating the need for keypunching. Interviewers enter the respondents’ answers directly into a computer terminal during the interview itself. Weighting the Data The survey was weighted to figures obtained from the March 2005 Current Population Survey (CPS) using age, sex, education, race and ethnicity and income. 25 Methodology Reliability of Survey Percentages It is important to bear in mind that the results from any sample survey are subject to sampling variation. The magnitude of this variation is measurable and is affected both by the number of interviews involved and by the level of the percentages expressed in the results. Table B-2 shows the range of sampling variation that applies to percentage results for this survey. The chances are 95 in 100 that the survey results do not vary, plus or minus, by more than the indicated number of percentage points from the results that would have been obtained had interviews been conducted with all persons in the universe represented by the sample. For example, if the response for a sample size of 200 is 30 percent, then in 95 cases out of 100 the response in the total population would be between 24 percent and 36 percent. Note that survey results based on subgroups of small size can be subject to larger sampling error. Unfortunately, there are several other possible sources of error in all polls or surveys that are probably more serious than theoretical calculations of sampling error. They include refusals to be interviewed (non-response), question wording and question order, interviewer bias, weighting by demographic control data and screening (e.g. for likely voters). It is difficult or impossible to quantify the errors that may result from these factors. 26 Methodology Exhibit B.2 Approximate Sampling Tolerances (At 95% Confidence) To Use In Evaluating Percentage Results Appearing In This Report Survey Percentage Result At 10% Or 90% Survey Percentage Result At 20% Or 80% Survey Percentage Result At 30% Or 70% Survey Percentage Result At 40% Or 60% Survey Percentage Result At 50% 1,000 2 2 3 3 3 900 2 3 3 3 3 800 2 3 3 3 3 700 2 3 3 4 4 600 2 3 4 4 4 500 3 4 4 4 4 400 3 4 4 5 5 300 3 5 5 6 6 200 4 6 6 7 7 100 6 8 9 10 10 50 8 11 13 14 14 Number Of People Asked Question On Which Survey Result Is Based 27 Methodology Sampling tolerances are also involved in the comparison of results from different surveys or from different parts of a sample (subgroup analysis). Table B-3 displays the percentage difference that must be obtained before a difference can be considered statistically significant. These figures also represent the 95 percent confidence level. For example, suppose that one group of 100 has a response of 34 percent “yes” to a question, and an independent group of 100 has a response of 28 percent “yes” to the same question, for an observed difference of six percentage points. Since the observed difference is less than the sampling error, the observed difference is not significance. 28 Methodology Exhibit B.3 Approximate Sampling Tolerances (At 95% Confidence) To Use In Evaluating Differences Between Two Percentage Results Appearing In This Report Survey Percentage Result At 10% Or 90% Survey Percentage Result At 20% Or 80% Survey Percentage Result At 30% Or 70% Survey Percentage Result At 40% Or 60% Survey Percentage Result At 50% 3 4 4 4 4 500 3 4 5 5 5 200 5 6 7 7 8 100 6 8 9 10 10 50 9 11 13 14 14 500 vs. 500 4 5 6 6 6 200 5 7 8 8 8 100 6 9 10 11 11 50 9 12 13 14 15 200 vs. 200 6 8 9 10 10 100 7 10 11 12 12 50 9 12 14 15 15 8 11 13 14 14 10 14 16 17 17 12 16 18 19 20 Approximate Sample Size Of Two Groups Asked Question On Which Survey Result Is Based 1,000 vs. 1,000 100 vs. 100 50 50 vs. 50 29 Methodology Non-Sampling Error Sampling error is only one way in which survey findings may vary from the findings that would result from interviewing every member of the relevant population. Survey research is susceptible to human and mechanical errors as well, such as respondent recording errors, in addition to errors resulting from the experimental nature of current Internet research. However, the procedures used by the Harris firm, including the sampling and interviewing systems described earlier, keep these types of errors to a minimum. 30