Y-Test-Foresight-Hindsight-short
Q129 Informed Consent This survey is part of a research study conducted by Alexander L. Davis at
Carnegie Mellon University. The purpose of the research is to learn about peoples’ scientific intuitions.
Procedures You will be given a questionnaire which concerns your scientific intuitions. We would like to
ask you a number of questions about experiments that have recently been conducted or will be
conducted in the near future. Participant Requirements Participation in this study is limited to
individuals age 18 and older. Risks The risks and discomfort associated with participation in this study
are no greater than those ordinarily encountered in daily life or during other online activities. Benefits
There may be no personal benefit from your participation in the study but the knowledge received may
be of value to humanity. Compensation & Costs You will be paid $4 for your participation. There will
be no cost to you if you participate in this study.
Confidentiality By participating in this research,
you understand and agree that Carnegie Mellon may be required to disclose your consent form, data
and other personally identifiable information as required by law, regulation, subpoena or court
order. Otherwise, your confidentiality will be maintained in the following manner:
Your data and
consent form will be kept separate. Your consent form will be stored in a locked location on Carnegie
Mellon property and will not be disclosed to third parties. By participating, you understand and agree
that the data and information gathered during this study may be used by Carnegie Mellon and published
and/or disclosed by Carnegie Mellon to others outside of Carnegie Mellon. However, your name,
address, contact information and other direct personal identifiers in your consent form will not be
mentioned in any such publication or dissemination of the research data and/or results by Carnegie
Mellon.
Right to Ask Questions & Contact Information If you have any questions about this study,
you should feel free to ask them by contacting the Principal Investigator now at Alexander L. Davis,
Department of Social and Decision Sciences, Pittsburgh, PA, 15213, Porter Hall 208A, 412-216-2040,
ald1@andrew.cmu.edu. If you have questions later, desire additional information, or wish to withdraw
your participation please contact the Principle Investigator by mail, phone or e-mail in accordance with
the contact information listed above.
If you have questions pertaining to your rights as a research
participant; or to report objections to this study, you should contact the Research Regulatory
Compliance Office at Carnegie Mellon University. Email: irb-review@andrew.cmu.edu . Phone: 412-2681901 or 412-268-5460.
The Carnegie Mellon University Institutional Review Board (IRB) has approved
the use of human participants for this study.
Voluntary Participation Your participation in this
research is voluntary. You may discontinue participation at any time during the research activity.
Q130 I am age 18 or older.
 Yes (1)
 No (2)
Q131 I have read and understand the information above.
 Yes (1)
 No (2)
Q132 I want to participate in this research and continue with the survey.
 Yes (1)
 No (2)
Q112 This survey requires sound. Please turn up the sound on your computer now.
Q92 The Y-Test of Scientific Intuitions
Q151 The Y-test experiment
Q152 The Y-test experiment
Q153 The Y-test experiment
Q154 The Y-test experiment
Q6 Here we tell you about the experiment with letters on the Y.
Q155
The child moves to the back of the easel.
Q11
Here letters are shown on the back of the easel.
Q13 Here is the front and back of the easel side-by-side.
Q17 The child could put the dot in Area A.
Q156 The child could put the dot in Area B.
Q22 The child could put the dot in Area C.
Q173
Q24
Q174
Q15
Q427 In your opinion, how likely is the child to place the dot in areas A, B, C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q428 Please explain why you think the child will do this. Please think carefully and be explicit
here. Your response will be used later in the survey.
Q16 Please give the reason you described above a short name. We will call it by this name for the rest
of the survey.
Q391 In your opinion, what is the probability that ${q://QID16/ChoiceTextEntryValue} is true?
______ Probability that ${q://QID16/ChoiceTextEntryValue} is true. (1)
Q176
Q175
Q446 Quiz Where did the child put the red dot?
perspective looking at the back of the easel.
Note: Answer this question from the child's
 Area A (1)
 Area B (2)
 Area C (3)
Q292 We will not show you the real outcome of the experiment because the data has not been
collected yet.
We would like you to answer the remaining questions in the survey imagining the child
placed the red dot in area A.
Q447 Quiz You should answer the remaining questions in the survey imagining the child places the
red dot in what area? Note: Answer this question from the child's perspective looking at the back of
the easel.
 Area A (1)
 Area B (2)
 Area C (3)
Q314
We will not show you the real outcome of the experiment because the data has not been
collected yet.
We would like you to answer the remaining questions in the survey imagining the child
placed the red dot in area B.
Q315 Quiz You should answer the remaining questions in the survey imagining the child places the
red dot in what area? Note: Answer this question from the child's perspective looking at the back of
the easel.
 Area A (1)
 Area B (2)
 Area C (3)
Q191
Q192
Q193 Quiz Where did the child put the red dot?
perspective looking at the back of the easel.
 Area A (1)
 Area B (2)
 Area C (3)
Note: Answer this question from the child's
Q212
Q213
Q214 Quiz Where did the child put the red dot?
perspective looking at the back of the easel.
 Area A (1)
 Area B (2)
 Area C (3)
Note: Answer this question from the child's
Q339
We will not show you the real outcome of the experiment because the data has not been
collected yet.
We would like you to answer the remaining questions in the survey imagining the child
placed the red dot in area C.
Q334 Quiz You should answer the remaining questions in the survey imagining the child places the
red dot in what area? Note: Answer this question from the child's perspective looking at the back of
the easel.
 Area A (1)
 Area B (2)
 Area C (3)
Q431 Please explain why you think the child did this. Please think carefully and be explicit here. Your
response will be used later in the survey.
Q432 Please give the reason you described above a short name. We will call it by this name for the rest
of the survey. If it is the same as the reason you named earlier, just write "Same" in the
textbox below.
Q433 In your opinion, what is the probability that ${q://QID432/ChoiceTextEntryValue} is
true? Recall your description of ${q://QID432/ChoiceTextEntryValue}:
${q://QID431/ChoiceTextEntryValue}
______ Probability that ${q://QID432/ChoiceTextEntryValue} is true. (1)
Q445 Please describe below why you think ${q://QID16/ChoiceTextEntryValue} is true or false. Recall
your description of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue}
Q435 In your opinion, what is the probability that ${q://QID16/ChoiceTextEntryValue} is true?
______ Probability that ${q://QID16/ChoiceTextEntryValue} is true. (1)
Q69 Education Policy The U.S. Department of Education asked this scientist to provide data to help
develop new preschool curriculum. The scientist has decided to share data from other children on the
Ytest. The scientist needs to decide whether or not to share this child’s response. Do you think the
scientist should share this child's response?





Definitely don't share this response. (1)
Don't share this response. (2)
Unsure (3)
Share this response. (4)
Definitely share this response. (5)
Q452 If you have additional information about your opinion, please describe it here.
Q448 Education Policy To what extent do you think this child's response will be informative for the
U.S. Department of Education in developing their new preschool curriculum?





Not at all (1)
Somewhat (2)
Moderately (3)
Strongly (4)
Extremely (5)
Q127 If you have additional information about your opinion, please describe it here.
Q458 Is it possible for
${q://QID16/ChoiceTextEntryValue} to be true and
${q://QID432/ChoiceTextEntryValue} to be true at the same time? Recall your description
of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue} Recall your description
of ${q://QID432/ChoiceTextEntryValue}: ${q://QID431/ChoiceTextEntryValue}
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q494 If you have additional information about your opinion, please describe it here.
Q486 In your opinion, what is the probability that
${q://QID432/ChoiceTextEntryValue} is true?
______ Probability (1)
${q://QID16/ChoiceTextEntryValue} is true and
Q415 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID16/ChoiceTextEntryValue} is true and ${q://QID432/ChoiceTextEntryValue} is true
Recall your description of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue}
Recall your description of ${q://QID432/ChoiceTextEntryValue}:
${q://QID431/ChoiceTextEntryValue}
Q416
In your opinion, if
${q://QID16/ChoiceTextEntryValue} is true
and
${q://QID432/ChoiceTextEntryValue} is true
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q417 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q457 Is it possible for
${q://QID16/ChoiceTextEntryValue} to be false and
${q://QID432/ChoiceTextEntryValue} to be false at the same time? Recall your description
of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue} Recall your description
of ${q://QID432/ChoiceTextEntryValue}: ${q://QID431/ChoiceTextEntryValue}
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q495 If you have additional information about your opinion, please describe it here.
Q487 In your opinion, what is the probability that
and ${q://QID432/ChoiceTextEntryValue} is false?
______ Probability (1)
${q://QID16/ChoiceTextEntryValue} is false
Q442 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID16/ChoiceTextEntryValue} is false and ${q://QID432/ChoiceTextEntryValue} is false
Recall your description of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue}
Recall your description of ${q://QID432/ChoiceTextEntryValue}: ${q://QID431/ChoiceTextEntryValue}
Q443
In your opinion, if
${q://QID16/ChoiceTextEntryValue} is false
and
${q://QID432/ChoiceTextEntryValue} is false
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q444 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q456 Is it possible for
${q://QID16/ChoiceTextEntryValue} to be false and
${q://QID432/ChoiceTextEntryValue} to be true
at the same time? Recall your description
of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue} Recall your description
of ${q://QID432/ChoiceTextEntryValue}: ${q://QID431/ChoiceTextEntryValue}
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q496 If you have additional information about your opinion, please describe it here.
Q488 In your opinion, what is the probability that
and ${q://QID432/ChoiceTextEntryValue} is true?
______ Probability (1)
${q://QID16/ChoiceTextEntryValue} is false
Q439 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID16/ChoiceTextEntryValue} is false and ${q://QID432/ChoiceTextEntryValue} is true
Recall your description of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue}
Recall your description of ${q://QID432/ChoiceTextEntryValue}: ${q://QID431/ChoiceTextEntryValue}
Q440
In your opinion, if
${q://QID16/ChoiceTextEntryValue} is false
and
${q://QID432/ChoiceTextEntryValue} is true
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q441 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q455 Is it possible for
${q://QID16/ChoiceTextEntryValue} to be true and
${q://QID432/ChoiceTextEntryValue} to be false
at the same time? Recall your description
of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue} Recall your description
of ${q://QID432/ChoiceTextEntryValue}: ${q://QID431/ChoiceTextEntryValue}
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q497 If you have additional information about your opinion, please describe it here.
Q489 In your opinion, what is the probability that
${q://QID432/ChoiceTextEntryValue} is false?
______ Probability (1)
${q://QID16/ChoiceTextEntryValue} is true and
Q436 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID16/ChoiceTextEntryValue} is true and ${q://QID432/ChoiceTextEntryValue} is false
Recall your description of ${q://QID16/ChoiceTextEntryValue}: ${q://QID428/ChoiceTextEntryValue}
Recall your description of ${q://QID432/ChoiceTextEntryValue}: ${q://QID431/ChoiceTextEntryValue}
Q437
In your opinion, if
${q://QID16/ChoiceTextEntryValue} is true
and
${q://QID432/ChoiceTextEntryValue} is false
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q438 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q459 Would you like to revise your description of ${q://QID16/ChoiceTextEntryValue} to make your
language more precise? Please only do this to be more specific, but do not make changes to your
general reasons. Recall your description of ${q://QID16/ChoiceTextEntryValue}:
${q://QID428/ChoiceTextEntryValue}
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q460 Please write your revised description of ${q://QID16/ChoiceTextEntryValue} below.
Q461 Please give the revised description a short name.
Q468 In your opinion, what is the probability that ${q://QID461/ChoiceTextEntryValue} is
true? Recall your description of ${q://QID461/ChoiceTextEntryValue}:
${q://QID460/ChoiceTextEntryValue}
______ Probability that ${q://QID461/ChoiceTextEntryValue} is true. (1)
Q462 Would you like to revise your description of ${q://QID432/ChoiceTextEntryValue} to make your
language more precise? Please only do this to be more specific, but do not make changes to your
general reasons. Recall your description of ${q://QID432/ChoiceTextEntryValue}:
${q://QID431/ChoiceTextEntryValue}
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q463 Please write your revised description of ${q://QID432/ChoiceTextEntryValue} below.
Q464 Please give the revised description a short name.
Q467 In your opinion, what is the probability that ${q://QID464/ChoiceTextEntryValue} is
true? Recall your description of ${q://QID464/ChoiceTextEntryValue}:
${q://QID463/ChoiceTextEntryValue}
______ Probability that ${q://QID464/ChoiceTextEntryValue} is true. (1)
Q469 Is it possible for
${q://QID461/ChoiceTextEntryValue} to be true and
${q://QID464/ChoiceTextEntryValue} to be true at the same time?
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q490 In your opinion, what is the probability that
and ${q://QID464/ChoiceTextEntryValue} is true?
______ Probability (1)
${q://QID461/ChoiceTextEntryValue} is true
Q470 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID461/ChoiceTextEntryValue} is true and ${q://QID464/ChoiceTextEntryValue} is true
Recall your description of ${q://QID461/ChoiceTextEntryValue}: ${q://QID460/ChoiceTextEntryValue}
Recall your description of ${q://QID464/ChoiceTextEntryValue}:
${q://QID463/ChoiceTextEntryValue}
Q471
In your opinion, if
${q://QID461/ChoiceTextEntryValue} is true
and
${q://QID464/ChoiceTextEntryValue} is true
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q472 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q473 Is it possible for
${q://QID461/ChoiceTextEntryValue} to be false and
${q://QID464/ChoiceTextEntryValue} to be false at the same time?
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q491 In your opinion, what is the probability that
and ${q://QID464/ChoiceTextEntryValue} is false?
______ Probability (1)
${q://QID461/ChoiceTextEntryValue} is false
Q474 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID461/ChoiceTextEntryValue} is false and ${q://QID464/ChoiceTextEntryValue} is false
Recall your description of ${q://QID461/ChoiceTextEntryValue}: ${q://QID460/ChoiceTextEntryValue}
Recall your description of ${q://QID464/ChoiceTextEntryValue}: ${q://QID463/ChoiceTextEntryValue}
Q475
In your opinion, if
${q://QID461/ChoiceTextEntryValue} is false
and
${q://QID464/ChoiceTextEntryValue} is false
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q476 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q477 Is it possible for
${q://QID461/ChoiceTextEntryValue} to be false and
${q://QID464/ChoiceTextEntryValue} to be true
at the same time?
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q492 In your opinion, what is the probability that
and ${q://QID464/ChoiceTextEntryValue} is true?
______ Probability (1)
${q://QID461/ChoiceTextEntryValue} is false
Q478 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID461/ChoiceTextEntryValue} is false and ${q://QID464/ChoiceTextEntryValue} is true
Recall your description of ${q://QID461/ChoiceTextEntryValue}: ${q://QID460/ChoiceTextEntryValue}
Recall your description of ${q://QID464/ChoiceTextEntryValue}: ${q://QID463/ChoiceTextEntryValue}
Q479
In your opinion, if
${q://QID461/ChoiceTextEntryValue} is false
and
${q://QID464/ChoiceTextEntryValue} is true
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q480 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q481 Is it possible for
${q://QID461/ChoiceTextEntryValue} to be true and
${q://QID464/ChoiceTextEntryValue} to be false
at the same time?
 Yes (1)
 No (2)
If No Is Selected, Then Skip To End of Block
Q493 In your opinion, what is the probability that
and ${q://QID464/ChoiceTextEntryValue} is false?
______ Probability (1)
${q://QID461/ChoiceTextEntryValue} is true
Q482 Please describe below why you think the child would place the dot in areas A, B, or C if
${q://QID461/ChoiceTextEntryValue} is true and ${q://QID464/ChoiceTextEntryValue} is false
Recall your description of ${q://QID461/ChoiceTextEntryValue}: ${q://QID460/ChoiceTextEntryValue}
Recall your description of ${q://QID464/ChoiceTextEntryValue}: ${q://QID463/ChoiceTextEntryValue}
Q483
In your opinion, if
${q://QID461/ChoiceTextEntryValue} is true
and
${q://QID464/ChoiceTextEntryValue} is false
How likely is the child to place the dot in areas A, B,
C?
______ Area A (1)
______ Area B (2)
______ Area C (3)
Q484 Timing
First Click (1)
Last Click (2)
Page Submit (3)
Click Count (4)
Q2 Quiz 1
Where is the yellow dot on the front of the easel?
child's perspective looking at the front of the easel.
 Lower left third (1)
 Lower right third (2)
 Upper third (3)
Note: Answer this question from the
Q7 Quiz 2
Where is the yellow dot on the front of the easel?
the child's perspective looking at the front of the easel.
 Area A (1)
 Area B (2)
 Area C (3)
Note: Answer this question from
Q9 Quiz 3 What did the scientist ask the child to do?
 Imagine a hole through the easel where the yellow dot was. Make a red dot where the hole was. (1)
 Make a hole in the easel. Place a yellow dot in the hole. (2)
 Make a red dot on the easel. The scientist would place a hole on the opposite side. (3)
Q10 Quiz 4 Where is the hole on the back of the easel? Note: Answer this question from the child's
perspective looking at the back of the easel.
 Lower right third (1)
 Lower left third (2)
 Upper third (3)
Q12 Quiz 5 What letter is in the lower-right third on the back of the easel? Note: Answer this
question from the child's perspective looking at the back of the easel.
 Area A (1)
 Area B (2)
 Area C (3)
Q25 Quiz 6 Where did the child put the red dot?
perspective looking at the back of the easel.
Note: Answer this question from the child's
 Area A (1)
 Area B (2)
 Area C (3)
Q40 Are you male or female?
 Male (1)
 Female (2)
Q54 What is your age?
Q55 How many semester-long courses have you taken in each of the following areas (include courses
you are taking now):
Number of Courses (1)
Physics, Biology, or Chemistry (1)
Engineering (2)
Mathematics (3)
Statistics (4)
Computer Science (5)
Psychology (6)
Other Natural Science (7)
Other Social Science (8)
Q76 We are now going to ask you questions about your experience with the survey. Your honest
answers are very appreciated and can help us improve the survey.
Q128 Please write any further comments about the experiment, including concerns or confusions you
may have had.
Q72 Did you take the task seriously?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q73 If not, what would get you to take the task seriously?
Q74 Did you try hard at the task?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q75 If not, what would get you to try hard?
Q77 Did you care about the task?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q78 If not, what would get you to care about the task?
Q79 Did you think carefully about the information you were given before responding?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q80 If not, what would get you to reason more carefully?
Q81 Did you respond honestly?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q82 Was the money enough to motivate you?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q83 Did you find the visual layout and design interesting and appealing?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q84 Did you find the questions easy or difficult to understand and answer?





Very easy (1)
Easy (2)
Neither easy nor difficult (3)
Difficult (4)
Very difficult (5)
Q85 Was the questionnaire too short or too long?





Very short (1)
Short (2)
Good length (3)
Long (4)
Very long (5)
Q86 How important was the task to you?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q87 How satisfied were you with your experience overall?





Not at all (1)
Somewhat (2)
Moderately (3)
Very (4)
Extremely (5)
Q88 What did you like most about the task?
Q89 What did you like least about the task?
Q90 Do you have any recommendations for improvement?
Q365 Please type the following code into the MTurk textbox: 83749871934571