i>`ˆ˜}Ê ˆÌiÀ>VÞ

,i>`}ÊÌiÀ>VÞ $ElNITIONOFTHEDOMAIN 4EXTFORMAT s#ONTINUOUSTEXTS s.ONCONTINUOUSTEXTS #HARACTERISTICSOFTHEITEMS s&IVEPROCESSESASPECTS s)TEMTYPES s-ARKING 3ITUATIONS 2EPORTINGOFOUTCOMES s3CALINGTHEREADINGLITERACYTASKS s2EPORTING s"UILDINGANITEMMAP s,EVELSOFREADINGLITERACYPROlCIENCY ,i>`}ÊÌiÀ>VÞÊ $%&).)4)/./&4(%$/-!). $ElNITIONSOFREADINGANDREADINGLITERACYHAVECHANGEDOVERTIMEINPARALLEL WITH CHANGES IN SOCIETY THE ECONOMY AND CULTURE4HE CONCEPT OF LEARNING ANDPARTICULARLYTHECONCEPTOFLIFELONGLEARNINGHASEXPANDEDPERCEPTIONSOF READINGLITERACYANDTHEDEMANDSMADEONIT,ITERACYISNOLONGERCONSIDERED AN ABILITY ONLY ACQUIRED IN CHILDHOOD DURING THE EARLY YEARS OF SCHOOLING )NSTEAD IT IS VIEWED AS AN EXPANDING SET OF KNOWLEDGE SKILLS AND STRATEGIES WHICH INDIVIDUALS BUILD ON THROUGHOUT LIFE IN VARIOUS SITUATIONSAND THROUGH INTERACTION WITH THEIR PEERS AND WITH THE LARGER COMMUNITIES IN WHICH THEY PARTICIPATE 4HROUGHACONSENSUSBUILDINGPROCESSINVOLVINGTHEREADINGEXPERTSSELECTEDBY THEPARTICIPATINGCOUNTRIESANDTHE/%#$0)3!ADVISORYGROUPSTHEFOLLOWING DElNITIONOFREADINGLITERACYWASADOPTEDFORTHESURVEY h2EADINGLITERACYISUNDERSTANDINGUSINGANDREmECTINGONWRITTENTEXTSINORDERTO ACHIEVE ONES GOALSTO DEVELOP ONES KNOWLEDGE AND POTENTIAL AND TO PARTICIPATE IN SOCIETYv 4HIS DElNITION GOES BEYOND THE NOTION OF READING LITERACY AS DECODING AND LITERALCOMPREHENSIONITIMPLIESTHATREADINGLITERACYINVOLVESUNDERSTANDING USINGANDREmECTINGONWRITTENINFORMATIONFORAVARIETYOFPURPOSES)TTHUS TAKES INTO ACCOUNT THE ACTIVE AND INTERACTIVE ROLE OF THE READER IN GAINING MEANINGFROMWRITTENTEXTS4HEDElNITIONALSORECOGNISESTHEFULLSCOPEOF SITUATIONSINWHICHREADINGLITERACYPLAYSAROLEFORYOUNGADULTSFROMPRIVATE TOPUBLICFROMSCHOOLTOWORKFROMACTIVECITIZENSHIPTOLIFELONGLEARNING)T SPELLSOUTTHEIDEATHATLITERACYENABLESTHEFULlLMENTOFINDIVIDUALASPIRATIONS n FROM DElNED ASPIRATIONS SUCH AS GAINING AN EDUCATIONAL QUALIlCATION OR OBTAINING A JOB TO THOSE LESS IMMEDIATE GOALS WHICH ENRICH AND EXTEND ONESPERSONALLIFE,ITERACYALSOPROVIDESTHEREADERWITHASETOFLINGUISTIC TOOLS THAT ARE INCREASINGLY IMPORTANT FOR MEETING THE DEMANDS OF MODERN SOCIETIESWITHTHEIRFORMALINSTITUTIONSLARGEBUREAUCRACIESANDCOMPLEXLEGAL SYSTEMS 2EADERS RESPOND TO A GIVEN TEXT IN A VARIETY OF WAYS AS THEY SEEK TO USE AND UNDERSTANDWHATTHEYAREREADING4HISDYNAMICPROCESSINVOLVESMANYFACTORS SOME OF WHICH CAN BE MANIPULATED IN LARGESCALE ASSESSMENTS SUCH AS /%#$ 0)3!4HESEINCLUDETHEREADINGSITUATIONTHESTRUCTUREOFTHETEXTITSELFANDTHE CHARACTERISTICSOFTHEQUESTIONSTHATAREASKEDABOUTTHETEXTTHETESTRUBRIC!LL OFTHESEFACTORSAREREGARDEDASIMPORTANTCOMPONENTSOFTHEREADINGPROCESSAND WEREMANIPULATEDINTHECREATIONOFTHEITEMSUSEDINTHEASSESSMENT )N ORDER TO USE TEXT FORMAT CHARACTERISTICS OF THE ITEMS AND SITUATIONS IN CONSTRUCTINGTHEASSESSMENTTASKSANDLATERININTERPRETINGTHERESULTSTHERANGE FOREACHOFTHESEFACTORSHADTOBESPECIlED4HISALLOWEDFORTHECATEGORISATION OF EACH TASK SO THAT THE WEIGHTING OF EACH COMPONENT COULD BE TAKEN INTO ACCOUNTINTHElNALASSEMBLYOFTHESURVEY £än 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ 4%84&/2-!4 !TTHEHEARTOFTHE/%#$0)3!ASSESSMENTISADISTINCTIONBETWEENCONTINUOUS ANDNONCONTINUOUSTEXTS s#ONTINUOUSTEXTSARETYPICALLYCOMPOSEDOFSENTENCESTHATAREINTURNORGANISED INTO PARAGRAPHS4HESE MAY lT INTO EVEN LARGER STRUCTURES SUCH AS SECTIONS CHAPTERS AND BOOKS4HE PRIMARY CLASSIlCATION OF CONTINUOUS TEXTS IS BY RHETORICALPURPOSEORTEXTTYPE ,i>`}ÊÌiÀ>VÞÊ s.ONCONTINUOUSTEXTSORDOCUMENTSASTHEYAREKNOWNINSOMEAPPROACHES CANBECATEGORISEDINTWOWAYS/NEISTHEFORMALSTRUCTUREAPPROACHUSED IN THE WORK OF +IRSCH AND -OSENTHAL 4HEIR WORK CLASSIlES TEXTS BY THE WAY UNDERLYING LISTS ARE PUT TOGETHER TO CONSTRUCT THE VARIOUS NONCONTINUOUS TEXT TYPES4HIS APPROACH IS USEFUL FOR UNDERSTANDING THE SIMILARITIESANDDIFFERENCESBETWEENTYPESOFNONCONTINUOUSTEXTS4HEOTHER METHODOFCLASSIlCATIONISBYEVERYDAYDESCRIPTIONSOFTHEFORMATSOFTHESE TEXTS4HIS SECOND APPROACH IS USED IN CLASSIFYING NONCONTINUOUS TEXTS IN /%#$0)3! #ONTINUOUSTEXTS 4EXT TYPES ARE STANDARD WAYS OF ORGANISING CONTINUOUS TEXTS BY CONTENT AND AUTHORSPURPOSE s.ARRATIONISTHETYPEOFTEXTINWHICHTHEINFORMATIONREFERSTOPROPERTIESOF OBJECTSINTIME.ARRATIVETEXTSTYPICALLYPROVIDEANSWERSTOhWHENvORhIN WHATSEQUENCEvQUESTIONS s%XPOSITION IS THE TYPE OF TEXT IN WHICH THE INFORMATION IS PRESENTED AS COMPOSITECONCEPTSORMENTALCONSTRUCTSORELEMENTSINTOWHICHCONCEPTSOR MENTALCONSTRUCTSCANBEANALYSED4HETEXTPROVIDESANEXPLANATIONOFHOW THECOMPONENTELEMENTSINTERRELATEINAMEANINGFULWHOLEANDOFTENANSWERS hHOWvQUESTIONS s$ESCRIPTIONISTHETYPEOFTEXTINWHICHTHEINFORMATIONREFERSTOPROPERTIES OFOBJECTSINSPACE$ESCRIPTIVETEXTSTYPICALLYPROVIDEANANSWERTOhWHATv QUESTIONS s!RGUMENTATIONISTHETYPEOFTEXTTHATPRESENTSPROPOSITIONSASTOTHERELATIONSHIP BETWEENCONCEPTSOROTHERPROPOSITIONS!RGUMENTATIVETEXTSOFTENANSWER hWHYvQUESTIONS!NOTHERIMPORTANTSUBCLASSIlCATIONOFARGUMENTATIVETEXTS ISPERSUASIVETEXTS s)NSTRUCTION SOMETIMES CALLED INJUNCTION IS THE TYPE OF TEXT THAT PROVIDES DIRECTIONS ON WHAT TO DO AND INCLUDES PROCEDURES RULES REGULATIONS AND STATUTESSPECIFYINGCERTAINBEHAVIOURS s! DOCUMENT OR RECORD IS A TEXT THAT IS DESIGNED TO STANDARDISE AND CONSERVE INFORMATION )T CAN BE CHARACTERISED BY HIGHLY FORMALISED TEXTUAL AND FORMATTINGFEATURES ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS £ä ,i>`}ÊÌiÀ>VÞÊ s(YPERTEXTISASETOFTEXTSLOTSLINKEDTOGETHERINSUCHAWAYTHATTHEUNITSCANBE READINDIFFERENTSEQUENCESALLOWINGREADERSTOFOLLOWVARIOUSROUTESTOTHE INFORMATION .ONCONTINUOUSTEXTS .ONCONTINUOUS TEXTS ARE ORGANISED DIFFERENTLY FROM CONTINUOUS TEXTS AND SO REQUIREDIFFERENTKINDSOFREADINGAPPROACHES4HEREADERSHOULDREFERTOTHEWORK OF+IRSCHAND-OSENTHALFORADISCUSSIONOFTHESTRUCTURALAPPROACH !CCORDINGTOTHEIRWORKLISTSARETHEMOSTELEMENTARYNONCONTINUOUSTEXTS4HEY CONSISTOFANUMBEROFENTRIESTHATSHARESOMEPROPERTYIES4HISSHAREDPROPERTY MAYBEUSEDASALABELORTITLEFORTHELIST,ISTSMAYHAVETHEIRENTRIESORDEREDEG THENAMESOFSTUDENTSINACLASSARRANGEDALPHABETICALLYORUNORDEREDEGALIST OFSUPPLIESTOBEBOUGHTATASHOP #LASSIFYING NONCONTINUOUS TEXTS BY THEIR FORMAT AS SHOWN BELOW PROVIDES A FAMILIAR MEANS OF DISCUSSING WHAT TYPES OF NONCONTINUOUS TEXTS MAY BE INCLUDEDINTHEASSESSMENT s#HARTS AND GRAPHS ARE ICONIC REPRESENTATIONS OF DATA4HEY ARE USED FOR THE PURPOSESOFSCIENTIlCARGUMENTATIONANDALSOINJOURNALSANDNEWSPAPERSTO DISPLAYNUMERICALANDTABULARPUBLICINFORMATIONINAVISUALFORMAT s4ABLES AND MATRICES4ABLES ARE ROW AND COLUMN MATRICES4YPICALLY ALL THE ENTRIESINEACHCOLUMNANDEACHROWSHAREPROPERTIESANDTHUSTHECOLUMN ANDROWLABELSAREPARTOFTHEINFORMATIONSTRUCTUREOFTHETEXT#OMMON TABLESINCLUDESCHEDULESSPREADSHEETSORDERFORMSANDINDEXES s$IAGRAMSOFTENACCOMPANYTECHNICALDESCRIPTIONSEGDEMONSTRATINGPARTSOF AHOUSEHOLDAPPLIANCEEXPOSITORYTEXTSANDINSTRUCTIVETEXTSEGILLUSTRATING HOW TO ASSEMBLE A HOUSEHOLD APPLIANCE )T IS OFTEN USEFUL TO DISTINGUISH PROCEDURALHOWTOFROMPROCESSHOWSOMETHINGWORKSDIAGRAMS s-APS ARE NONCONTINUOUS TEXTS THAT INDICATE THE GEOGRAPHICAL RELATIONSHIPS BETWEEN PLACES4HERE IS A VARIETY OF TYPES OF MAPS2OAD MAPS MARK THE DISTANCE AND ROUTES BETWEEN IDENTIlED PLACES4HEMATIC MAPS INDICATE THE RELATIONSHIPSBETWEENLOCATIONSANDSOCIALORPHYSICALFEATURES s&ORMSARESTRUCTUREDANDFORMATTEDTEXTSWHICHREQUESTTHEREADERTORESPOND TOSPECIlCQUESTIONSINSPECIlEDWAYS&ORMSAREUSEDBYMANYORGANISATIONS TOCOLLECTDATA4HEYOFTENCONTAINSTRUCTUREDORPRECODEDANSWERFORMATS 4YPICALEXAMPLESARETAXFORMSIMMIGRATIONFORMSVISAFORMSAPPLICATION FORMSSTATISTICALQUESTIONNAIRESETC s)NFORMATIONSHEETSDIFFERFROMFORMSINTHATTHEYPROVIDERATHERTHANREQUEST INFORMATION4HEY SUMMARISE INFORMATION IN A STRUCTURED WAY AND IN SUCH A FORMAT THAT THE READER CAN EASILY AND QUICKLY LOCATE SPECIlC PIECES OF INFORMATION )NFORMATION SHEETS MAY CONTAIN VARIOUS TEXT FORMS AS WELL AS LISTS TABLES lGURES AND SOPHISTICATED TEXTBASED GRAPHICS HEADINGS ££ä 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ FONTSINDENTATIONBORDERSETC TO SUMMARISE AND HIGHLIGHT INFORMATION 4IMETABLESPRICELISTSCATALOGUESANDPROGRAMMESAREEXAMPLESOFTHISTYPE OFNONCONTINUOUSTEXT s#ALLS AND ADVERTISEMENTS ARE DOCUMENTS DESIGNED TO INVITE THE READER TO DO SOMETHING EG TO BUY GOODS OR SERVICES ATTEND GATHERINGS OR MEETINGS ELECTAPERSONTOAPUBLICOFlCEETC4HEPURPOSEOFTHESEDOCUMENTSISTO PERSUADE THE READER4HEY OFFER SOMETHING AND REQUEST BOTH ATTENTION AND ACTION!DVERTISEMENTS INVITATIONS SUMMONSES WARNINGS AND NOTICES ARE EXAMPLESOFTHISDOCUMENTFORMAT ,i>`}ÊÌiÀ>VÞÊ s6OUCHERSTESTIFYTHATTHEIROWNERISENTITLEDTOCERTAINSERVICES4HEINFORMATION THATTHEYCONTAINMUSTBESUFlCIENTTOSHOWWHETHERTHEVOUCHERISVALIDOR NOT4YPICALEXAMPLESARETICKETSINVOICESETC s#ERTIlCATESAREWRITTENACKNOWLEDGEMENTSOFTHEVALIDITYOFANAGREEMENTORA CONTRACT4HEYAREFORMALISEDINCONTENTRATHERTHANFORMAT4HEYREQUIRETHE SIGNATUREOFONEORMOREPERSONSAUTHORISEDANDCOMPETENTTOBEARTESTIMONY OFTHETRUTHOFTHEGIVENSTATEMENT7ARRANTIESSCHOOLCERTIlCATESDIPLOMAS CONTRACTSETCAREDOCUMENTSTHATHAVETHESEPROPERTIES }ÕÀiÊÓ°£s$ISTRIBUTIONOFREADINGLITERACYTASKSBYTEXTFORMATANDTYPE 2EADINGASAMAJORDOMAIN0)3! 2EADINGASAMINORDOMAIN0)3! 4EXTFORMATANDTYPE 0ERCENTAGEOFTASKS BYTEXTFORMAT ANDTYPE s#ONTINUOUS .ARRATIVE %XPOSITORY $ESCRIPTIVE !RGUMENTATIVEANDPERSUASIVE )NJUNCTIVE 4/4!, s.ON#ONTINUOUS #HARTSANDGRAPHS 4ABLES $IAGRAMS -APS &ORMS !DVERTISEMENTS 4/4!, 0ERCENTAGEOFTASKSBY TEXTFORMATANDTYPEBASED ONTHEWHOLETEST $ATAMAYNOTALWAYSADDUPTOTHETOTALSINDICATEDBECAUSEOFROUNDINGS ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS £££ ,i>`}ÊÌiÀ>VÞÊ 4HEDISTRIBUTIONANDVARIETYOFTEXTSTHATSTUDENTSAREASKEDTOREADFOR/%#$ 0)3! ARE IMPORTANT CHARACTERISTICS OF THE ASSESSMENT &IGURE SHOWS THE DISTRIBUTIONS OF TASKS FOR CONTINUOUS AND NONCONTINUOUS TEXTS IN 0)3! READINGASMAJORDOMAINANDIN0)3!READINGASMINORDOMAIN)TCAN BE READILY SEEN THAT IN BOTH AND CONTINUOUS TEXTS REPRESENT TWO THIRDSOFTHETASKSORITEMSCONTAINEDINTHEASSESSMENT7ITHINTHISCATEGORYIN BOTHCYCLESTHELARGESTPERCENTAGECOMESFROMEXPOSITORYTEXTS #(!2!#4%2)34)#3/&4(%)4%-3 4HREESETSOFVARIABLESAREUSEDTODESCRIBETHECHARACTERISTICSOFTHEITEMSTHE PROCESSESASPECTSWHICHSETOUTTHETASKFORTHEEXAMINEEITEMTYPESWHICH SETOUTTHEWAYSINWHICHEXAMINEESAREASKEDTODEMONSTRATETHEIRPROlCIENCY ATTHETASKANDRULESFORMARKINGWHICHSPECIFYHOWEXAMINEESANSWERSARETO BEEVALUATED%ACHOFTHESEWILLBEDISCUSSEDINTURNTHOUGHTHElRSTREQUIRES CONSIDERABLYMOREATTENTION &IVEPROCESSESASPECTS )NANEFFORTTOSIMULATEAUTHENTICREADINGSITUATIONSTHE/%#$0)3!READING ASSESSMENT MEASURES THE FOLLOWING lVE PROCESSES ASSOCIATED WITH ACHIEVING A FULLUNDERSTANDINGOFATEXTWHETHERTHETEXTISCONTINUOUSORNONCONTINUOUS %XAMINEES ARE EXPECTED TO DEMONSTRATE THEIR PROlCIENCY IN ALL OF THESE PROCESSES sRETRIEVINGINFORMATION sFORMINGABROADGENERALUNDERSTANDING sDEVELOPINGANINTERPRETATION sREmECTINGONANDEVALUATINGTHECONTENTOFATEXTAND sREmECTINGONANDEVALUATINGTHEFORMOFATEXT 4HEFULLUNDERSTANDINGOFTEXTSINVOLVESALLOFTHESEPROCESSES)TISEXPECTEDTHAT ALLREADERSIRRESPECTIVEOFTHEIROVERALLPROlCIENCYWILLBEABLETODEMONSTRATE SOMELEVELOFCOMPETENCYINEACHOFTHEM,ANGER7HILETHEREISAN INTERRELATIONSHIPBETWEENTHElVEASPECTSnEACHMAYREQUIREMANYOFTHESAME UNDERLYING SKILLS n SUCCESSFULLY ACCOMPLISHING ONE MAY NOT ENSURE SUCCESSFUL COMPLETIONOFANYOTHER3OMEVIEWTHEMASBEINGINTHEREPERTOIREOFEACH READERATEVERYDEVELOPMENTALLEVELRATHERTHANFORMINGASEQUENTIALHIERARCHY ORSETOFSKILLS &IGURE IDENTIlES THE KEY DISTINGUISHING CHARACTERISTICS OF THE lVE PROCESSESOFREADINGMEASUREDIN/%#$0)3!7HILETHISlGURENECESSARILY OVERSIMPLIlES EACH PROCESSIT PROVIDES A USEFUL SCHEME FOR ORGANISING AND REMEMBERINGTHERELATIONSHIPSBETWEENTHEM!SDEPICTEDINTHISlGURETHE lVEPROCESSESCANBEDISTINGUISHEDINTERMSOFFOURCHARACTERISTICS4HElRST DEALS WITH THE EXTENT TO WHICH THE READER IS EXPECTED TO USE INFORMATION PRIMARILY FROM WITHIN THE TEXT OR TO DRAW ALSO UPON OUTSIDE KNOWLEDGE ££Ó 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ }ÕÀiÊÓ°Ós#HARACTERISTICSDISTINGUISHINGTHElVEPROCESSESASPECTS OFREADINGLITERACY 2EADING,ITERACY 5SEINFORMATIONPRIMARILY FROMWITHINTHETEXT &OCUSON INDEPENDENT PARTSOFTHETEXT $RAWUPONOUTSIDE KNOWLEDGE &OCUSON CONTENT &OCUSON RELATIONSHIPS WITHINTHETEXT 7HOLETEXT ,i>`}ÊÌiÀ>VÞÊ &OCUSON STRUCTURE 2ELATIONSHIPS AMONGPARTS OFTEXT 2ETRIEVE &ORMABROAD $EVELOPAN INFORMATION UNDERSTANDING INTERPRETATION 2EmECT 2EmECT ONAND ONAND EVALUATE EVALUATEFORM CONTENTOFTEXT OFTEXT ! SECOND CHARACTERISTIC INVOLVES THE EXTENT TO WHICH THE READER IS ASKED TO FOCUS ON INDEPENDENT PARTS OF THE TEXT OR ON THE RELATIONSHIPS WITHIN THE INFORMATION CONTAINED IN THE TEXT3OMETIMES READERS ARE EXPECTED TO RETRIEVEINDEPENDENTPIECESOFINFORMATIONWHILEATOTHERTIMESTHEYAREASKED TODEMONSTRATETHEIRUNDERSTANDINGOFTHERELATIONSHIPSBETWEENPARTSOFTHE TEXT&OCUSINGONEITHERTHEWHOLETEXTORONRELATIONSHIPSBETWEENPARTSOF THE TEXT IS THE THIRD DISTINGUISHING CHARACTERISTIC4HE FOURTH CHARACTERISTIC RELATESTOWHETHERTHEREADERISASKEDTODEALWITHTHECONTENTORSUBSTANCE OFTHETEXTRATHERTHANITSFORMORSTRUCTURE4HElVEPROCESSESOFREADINGARE REPRESENTEDINTHELASTLINEOF&IGUREATTHEENDSOFTHEVARIOUSBRANCHES "Y STARTING AT THE TOP OF THE lGURE AND FOLLOWING EACH BRANCH ONE CAN SEE WHICHCHARACTERISTICSAREASSOCIATEDWITHEACHPROCESS 4HEFOLLOWINGDISCUSSIONATTEMPTSTODElNEEACHPROCESSOPERATIONALLYANDTO ASSOCIATEITWITHPARTICULARKINDSOFITEMS!LTHOUGHEACHPROCESSISDISCUSSED INTERMSOFASINGLETEXTEACHCANALSOAPPLYTOMULTIPLETEXTSWHENTHESEARE PRESENTEDTOGETHERASAUNITWITHINTHETEST4HEDESCRIPTIONOFEACHPROCESSHAS TWOPARTS4HElRSTPROVIDESAGENERALOVERVIEWOFTHEPROCESSWHILETHESECOND DESCRIBESPARTICULARWAYSINWHICHTHEPROCESSMIGHTBEASSESSED ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS ££Î ,i>`}ÊÌiÀ>VÞÊ 2ETRIEVINGINFORMATION )NTHECOURSEOFDAILYLIFEREADERSOFTENNEEDAPARTICULARPIECEOFINFORMATION ATELEPHONENUMBERORTHEDEPARTURETIMEFORABUSORTRAIN4HEYMAYWANT TO lND A PARTICULAR FACT TO SUPPORT OR REFUTE A CLAIM SOMEONE HAS MADE)N SITUATIONSSUCHASTHESEREADERSAREINTERESTEDINRETRIEVINGISOLATEDPIECESOF INFORMATION4ODOSOREADERSMUSTSCANSEARCHFORLOCATEANDSELECTRELEVANT INFORMATION4HEPROCESSINGINVOLVEDISMOSTFREQUENTLYATTHESENTENCELEVEL THOUGHINSOMECASESTHEINFORMATIONMAYBEINTWOORMORESENTENCESORIN DIFFERENTPARAGRAPHS )NASSESSMENTTASKSTHATCALLFORRETRIEVINGINFORMATIONEXAMINEESMUSTMATCH INFORMATIONGIVENINTHEQUESTIONWITHEITHERIDENTICALLYWORDEDORSYNONYMOUS INFORMATIONINTHETEXTANDUSETHISTOlNDTHENEWINFORMATIONCALLEDFOR)N THESE TASKSRETRIEVING INFORMATION IS BASED ON THE TEXT ITSELF AND ON EXPLICIT INFORMATION INCLUDED IN IT 2ETRIEVING TASKS REQUIRE THE EXAMINEE TO lND INFORMATION BASED ON REQUIREMENTS OR FEATURES SPECIlED IN QUESTIONS4HE EXAMINEEHASTODETECTORIDENTIFYONEORMOREESSENTIALELEMENTSOFAQUESTION CHARACTERSPLACETIMESETTINGETCANDTHENTOSEARCHFORAMATCHTHATMAYBE LITERALORSYNONYMOUS 2ETRIEVING TASKS CAN INVOLVE VARIOUS DEGREES OF AMBIGUITY&OR EXAMPLETHE EXAMINEEMAYBEREQUIREDTOSELECTEXPLICITINFORMATIONSUCHASANINDICATION OFTIMEORPLACEINATEXTORTABLE!MOREDIFlCULTVERSIONOFTHISSAMETYPE OFTASKMIGHTINVOLVElNDINGSYNONYMOUSINFORMATION4HISSOMETIMESINVOLVES CATEGORISATIONSKILLSORITMAYREQUIREDISCRIMINATINGBETWEENTWOSIMILARPIECES OFINFORMATION4HEDIFFERENTLEVELSOFPROlCIENCYASSOCIATEDWITHTHISPROCESS OFCOMPREHENSIONCANBEMEASUREDBYSYSTEMATICALLYVARYINGTHEELEMENTSTHAT CONTRIBUTETOTHEDIFlCULTYOFTHETASK &ORMINGABROADGENERALUNDERSTANDING 4O FORM A BROAD GENERAL UNDERSTANDING OF WHAT HAS BEEN READ A READER MUST CONSIDER THE TEXT AS A WHOLE OR IN A BROAD PERSPECTIVE4HERE ARE VARIOUS ASSESSMENT TASKS IN WHICH READERS ARE ASKED TO FORM A BROAD GENERAL UNDERSTANDING%XAMINEESMAYDEMONSTRATEINITIALUNDERSTANDINGBYIDENTIFYING THEMAINTOPICORMESSAGEORBYIDENTIFYINGTHEGENERALPURPOSEORUSEOFTHE TEXT%XAMPLESINCLUDETASKSTHATREQUIRETHEREADERTOSELECTORCREATEATITLE ORTHESISFORTHETEXTTOEXPLAINTHEORDEROFSIMPLEINSTRUCTIONSORTOIDENTIFY THEMAINDIMENSIONSOFAGRAPHORATABLE/THERSINCLUDETASKSTHATREQUIRETHE EXAMINEETODESCRIBETHEMAINCHARACTERSETTINGORMILIEUOFASTORYTOIDENTIFY ATHEMEORMESSAGEOFALITERARYTEXTORTOEXPLAINTHEPURPOSEORUSEOFAMAP ORAlGURE 7ITHINTHISPROCESSSOMETASKSMIGHTREQUIRETHEEXAMINEETOMATCHAPARTICULAR PIECEOFTEXTTOTHEQUESTION&OREXAMPLETHISWOULDHAPPENWHENATHEMEOR MAINIDEAISEXPLICITLYSTATEDINTHETEXT/THERTASKSMAYREQUIRETHEEXAMINEE TOFOCUSONMORETHANONESPECIlCREFERENCEINTHETEXTnFORINSTANCEIFTHE READER HAD TO DEDUCE THE THEME FROM THE REPETITION OF A PARTICULAR CATEGORY ££{ 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ OFINFORMATION3ELECTINGTHEMAINIDEAIMPLIESESTABLISHINGAHIERARCHYAMONG IDEAS AND CHOOSING THE MOST GENERAL AND OVERARCHING 3UCH A TASK INDICATES WHETHERTHEEXAMINEECANDISTINGUISHBETWEENKEYIDEASANDMINORDETAILSOR CANRECOGNISETHESUMMARYOFTHEMAINTHEMEINASENTENCEORTITLE $EVELOPINGANINTERPRETATION ,i>`}ÊÌiÀ>VÞÊ $EVELOPINGANINTERPRETATIONREQUIRESREADERSTOEXTENDTHEIRINITIALIMPRESSIONS SOTHATTHEYDEVELOPAMORESPECIlCORCOMPLETEUNDERSTANDINGOFWHATTHEYHAVE READ4ASKSINTHISCATEGORYCALLFORLOGICALUNDERSTANDINGREADERSMUSTPROCESSTHE ORGANISATIONOFINFORMATIONINTHETEXT4ODOSOREADERSMUSTDEMONSTRATETHEIR UNDERSTANDINGOFCOHESIONEVENIFTHEYCANNOTEXPLICITLYSTATEWHATCOHESIONIS)N SOMEINSTANCESDEVELOPINGANINTERPRETATIONMAYREQUIRETHEREADERTOPROCESS A SEQUENCE OF JUST TWO SENTENCES RELYING ON LOCAL COHESIONWHICH MIGHT EVEN BE FACILITATED BY THE PRESENCE OF COHESIVE MARKERS SUCH AS THE USE OF hlRSTv ANDhSECONDvTOINDICATEASEQUENCE)NMOREDIFlCULTINSTANCESEGTOINDICATE RELATIONSOFCAUSEANDEFFECTTHEREMIGHTNOTBEANYEXPLICITMARKINGS %XAMPLESOFTASKSTHATMIGHTBEUSEDTOASSESSTHISPROCESSINCLUDECOMPARING AND CONTRASTING INFORMATION DRAWING INFERENCES AND IDENTIFYING AND LISTING SUPPORTING EVIDENCEh#OMPARE AND CONTRASTv TASKS REQUIRE THE EXAMINEE TO DRAWTOGETHERTWOORMOREPIECESOFINFORMATIONFROMTHETEXT)NORDERTO PROCESS EITHER EXPLICIT OR IMPLICIT INFORMATION FROM ONE OR MORE SOURCES IN SUCHTASKSTHEREADERMUSTOFTENINFERANINTENDEDRELATIONSHIPORCATEGORY4HIS PROCESSOFCOMPREHENSIONISALSOASSESSEDINTASKSTHATREQUIRETHEEXAMINEETO MAKEINFERENCESABOUTTHEAUTHORSINTENTIONANDTOIDENTIFYTHEEVIDENCEUSED TOINFERTHATINTENTION 2EmECTINGONANDEVALUATINGTHECONTENTOFATEXT 2EmECTINGONANDEVALUATINGTHECONTENTOFATEXTREQUIRESTHEREADERTOCONNECT INFORMATIONINATEXTTOKNOWLEDGEFROMOTHERSOURCES2EADERSMUSTALSOASSESS THECLAIMSMADEINTHETEXTAGAINSTTHEIROWNKNOWLEDGEOFTHEWORLD/FTEN READERSAREASKEDTOARTICULATEANDDEFENDTHEIROWNPOINTSOFVIEW4ODOSO READERSMUSTBEABLETODEVELOPANUNDERSTANDINGOFWHATISSAIDANDINTENDED INATEXT4HEYMUSTTHENTESTTHATMENTALREPRESENTATIONAGAINSTWHATTHEYKNOW ANDBELIEVEONTHEBASISOFEITHERPRIORINFORMATIONORINFORMATIONFOUNDIN OTHERTEXTS2EADERSMUSTCALLONSUPPORTINGEVIDENCEFROMWITHINTHETEXTAND CONTRASTTHATWITHOTHERSOURCESOFINFORMATIONUSINGBOTHGENERALANDSPECIlC KNOWLEDGEASWELLASTHEABILITYTOREASONABSTRACTLY !SSESSMENTTASKSREPRESENTATIVEOFTHISCATEGORYOFPROCESSINGINCLUDEPROVIDING EVIDENCE OR ARGUMENTS FROM OUTSIDE THE TEXT ASSESSING THE RELEVANCE OF PARTICULAR PIECES OF INFORMATION OR EVIDENCE OR DRAWING COMPARISONS WITH MORAL OR AESTHETIC RULES STANDARDS4HE EXAMINEE MIGHT BE ASKED TO OFFER ORIDENTIFYALTERNATIVEPIECESOFINFORMATIONTHATMIGHTSTRENGTHENANAUTHORS ARGUMENTORTOEVALUATETHESUFlCIENCYOFTHEEVIDENCEORINFORMATIONPROVIDED INTHETEXT ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS ££x ,i>`}ÊÌiÀ>VÞÊ 4HEOUTSIDEKNOWLEDGETOWHICHTEXTUALINFORMATIONISTOBECONNECTEDMAY COMEFROMTHEEXAMINEESOWNKNOWLEDGEFROMOTHERTEXTSPROVIDEDINTHE ASSESSMENTORFROMIDEASEXPLICITLYPROVIDEDINTHEQUESTION 2EmECTINGONANDEVALUATINGTHEFORMOFATEXT 4ASKS IN THIS CATEGORY REQUIRE READERS TO STAND APART FROM THE TEXTCONSIDER ITOBJECTIVELYANDEVALUATEITSQUALITYANDAPPROPRIATENESS+NOWLEDGEOFSUCH THINGS AS TEXT STRUCTURE GENRE AND REGISTER PLAY AN IMPORTANT ROLE IN THESE TASKS4HESEFEATURESWHICHFORMTHEBASISOFANAUTHORSCRAFTlGURESTRONGLY IN UNDERSTANDING STANDARDS INHERENT IN TASKS OF THIS NATURE %VALUATING HOW SUCCESSFULANAUTHORISINPORTRAYINGSOMECHARACTERISTICORPERSUADINGAREADER DEPENDS NOT ONLY ON SUBSTANTIVE KNOWLEDGE BUT ALSO ON THE ABILITY TO DETECT NUANCES IN LANGUAGE n FOR EXAMPLE UNDERSTANDING WHEN THE CHOICE OF AN ADJECTIVEMIGHTCOLOURINTERPRETATION 3OMEEXAMPLESOFASSESSMENTTASKSCHARACTERISTICOFREmECTINGONTHEFORMOFA TEXTINCLUDEDETERMININGTHEUTILITYOFAPARTICULARTEXTFORASPECIlEDPURPOSE ANDEVALUATINGANAUTHORSUSEOFPARTICULARTEXTUALFEATURESINACCOMPLISHINGA PARTICULARGOAL4HEEXAMINEEMAYALSOBECALLEDUPONTODESCRIBEORCOMMENT ONTHEAUTHORSUSEOFSTYLEANDTOIDENTIFYTHEAUTHORSPURPOSEANDATTITUDE &IGURESHOWSTHEDISTRIBUTIONOFREADINGLITERACYTASKSBYEACHOFTHETHREE SUBSCALESGENERATEDFROMTHElVEREADINGPROCESSESASPECTSDElNEDABOVE4HE LARGESTCATEGORYOFTASKSWHICHACCOUNTSFORAPPROXIMATELYPERCENTOFTHE TESTISREPRESENTEDBYTHETWOBRANCHESOF&IGURETHATASKSTUDENTSTOFOCUS ON RELATIONSHIPS WITHIN A TEXT4HESE TASKS REQUIRE STUDENTS EITHER TO FORM A BROADUNDERSTANDINGORTODEVELOPANINTERPRETATION4HEYHAVEBEENGROUPED TOGETHERFORREPORTINGPURPOSESINTOASINGLEPROCESSCALLEDINTERPRETINGTEXTS)N 0)3!ANDTHENEXTLARGESTCATEGORYWASMADEUPOFTHEPERCENT OFTHETASKSTHATREQUIRESTUDENTSTODEMONSTRATETHEIRSKILLATRETRIEVINGISOLATED PIECESOFINFORMATION%ACHOFTHESEPROCESSESnFORMINGABROADUNDERSTANDING RETRIEVINGINFORMATIONANDDEVELOPINGANINTERPRETATIONnFOCUSESONTHEDEGREE TOWHICHTHEREADERCANUNDERSTANDANDUSEINFORMATIONCONTAINEDPRIMARILY }ÕÀiÊÓ°Îs$ISTRIBUTIONOFREADINGLITERACYTASKSBYREADINGPROCESSASPECT 2EADINGASAMAJORDOMAIN0)3! 2EADINGASAMINORDOMAIN0)3!AND 2EADINGPROCESSASPECT 2ETRIEVINGINFORMATION )NTERPRETINGTEXTS 2EmECTIONANDEVALUATION 4/4!, ££È 0ERCENTAGEOFTASKS 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ ,i>`}ÊÌiÀ>VÞÊ WITHINTHETEXT4HEREMAININGOFTHETASKSAPPROXIMATELYPERCENTREQUIRED STUDENTSTOREmECTONEITHERTHECONTENTORINFORMATIONPROVIDEDINTHETEXTOR ONTHESTRUCTUREANDFORMOFTHETEXTITSELF )TEMTYPES &IGURE INDICATES THAT IN 0)3! AND AROUND PER CENT OF THE READINGLITERACYTASKSINTHE/%#$0)3!ASSESSMENTWEREOPENCONSTRUCTED RESPONSE ITEMS WHICH REQUIRED JUDGEMENT ON THE PART OF THE MARKER4HE REMAININGTASKSCONSISTOFCLOSEDCONSTRUCTEDRESPONSEITEMSTHATREQUIRELITTLE JUDGEMENTONTHEPARTOFTHEMARKERASWELLASSIMPLEMULTIPLECHOICEITEMS FOR WHICH STUDENTS CHOOSE ONE OF SEVERAL ALTERNATIVE ANSWERS AND COMPLEX MULTIPLECHOICEITEMSFORWHICHSTUDENTSCHOOSEMORETHANONERESPONSE 4HISTABLEALSOREVEALSTHATWHILEMULTIPLECHOICEANDOPENCONSTRUCTEDRESPONSE ITEMSAREREPRESENTEDACROSSTHEPROCESSESTHEYARENOTDISTRIBUTEDEVENLY! LARGERPERCENTAGEOFMULTIPLECHOICEITEMSAREASSOCIATEDWITHTHETWOPROCESSES DEALINGWITHINTERPRETINGRELATIONSHIPSWITHINATEXT4HISISSHOWNINTHESECOND ROW OF &IGURE )N CONTRASTWHILE REmECTION AND EVALUATION TASKS ACCOUNT FORAROUNDPERCENTIN0)3!ANDONLYPERCENTINARE MULTIPLECHOICE/FTHEREmECTIONANDEVALUATIONTASKSAROUNDPERCENTARE OPEN CONSTRUCTEDRESPONSE ITEMS THAT REQUIRE JUDGEMENT ON THE PART OF THE MARKER }ÕÀiÊÓ°{s$ISTRIBUTIONOFREADINGLITERACYTASKS BYREADINGPROCESSASPECTANDITEMTYPE 2EADINGASAMAJORDOMAIN0)3! 2EADINGASAMINORDOMAIN0)3! )TEMTYPES 0ROCESS ASPECT 0ERCENTAGE OFMULTIPLE CHOICEITEMS 0ERCENTAGE OFCOMPLEX MULTIPLE CHOICEITEMS 0ERCENTAGE 0ERCENTAGE OFCLOSED OFOPEN CONSTRUCTED CONSTRUCTED RESPONSEITEMS RESPONSEITEMS 4/4!, 2ETRIEVING INFORMATION )NTERPRETING TEXTS 2EmECTION ANDEVALUATION 4/4!, 4HISCATEGORYINCLUDESSHORTRESPONSEITEMS $ATAMAYNOTALWAYSADDUPTOTHETOTALSINDICATEDBECAUSEOFROUNDING ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS ££Ç ,i>`}ÊÌiÀ>VÞÊ -ARKING -ARKINGISRELATIVELYSIMPLEWITHDICHOTOMOUSLYSCOREDMULTIPLECHOICEITEMS THE EXAMINEE HAS EITHER CHOSEN THE DESIGNATED ANSWER OR NOT0ARTIALCREDIT MODELSALLOWFORMORECOMPLEXMARKINGOFITEMS(EREBECAUSESOMEWRONG ANSWERS ARE MORE COMPLETE THAN OTHERSEXAMINEES WHO PROVIDE ANhALMOST RIGHTvANSWERRECEIVEPARTIALCREDIT0SYCHOMETRICMODELSFORSUCHPOLYTOMOUS SCORINGAREWELLESTABLISHEDANDINSOMEWAYSAREPREFERABLETODICHOTOMOUS SCORINGASTHEYUTILISEMOREOFTHEINFORMATIONINTHERESPONSES)NTERPRETATION OF POLYTOMOUS MARKING IS MORE COMPLEX HOWEVER AS EACH TASK HAS SEVERAL LOCATIONSONTHEDIFlCULTYSCALEONEFORTHEFULLCREDITANSWERANDOTHERSFOR EACHOFTHEPARTIALCREDITANSWERS0ARTIALCREDITMARKINGISUSEDFORSOMEOFTHE MORECOMPLEXCONSTRUCTEDRESPONSEITEMSIN/%#$0)3! 3)45!4)/.3 4HE MANNER IN WHICH SITUATION WAS DElNED WAS BORROWED FROM THE #OUNCIL OF%UROPESWORKONLANGUAGE&OURSITUATIONVARIABLESWEREIDENTIlED READINGFORPRIVATEUSEREADINGFORPUBLICUSEREADINGFORWORKANDREADINGFOR EDUCATION7HILETHEINTENTIONOFTHE/%#$0)3!READINGLITERACYASSESSMENT WASTOMEASURETHEKINDSOFREADINGTHATOCCURBOTHWITHINANDOUTSIDECLASSROOMS THEMANNERINWHICHSITUATIONWASDElNEDCOULDNOTBEBASEDSIMPLYONWHERE THEREADINGACTIVITYISCARRIEDOUT&OREXAMPLETEXTBOOKSAREREADBOTHINSCHOOLS ANDINHOMESANDTHEPROCESSANDPURPOSEOFREADINGTHESETEXTSDIFFERLITTLEFROM ONESETTINGTOANOTHER-OREOVERREADINGALSOINVOLVESTHEAUTHORSINTENDEDUSE DIFFERENTTYPESOFCONTENTANDTHEFACTTHATOTHERSEGTEACHERSANDEMPLOYERS SOMETIMESDECIDEWHATSHOULDBEREADANDFORWHATPURPOSE 4HUS FOR THE PURPOSE OF THIS ASSESSMENT SITUATION CAN BE UNDERSTOOD AS A GENERAL CATEGORISATION OF TEXTS BASED ON THE AUTHORS INTENDED USE ON THE RELATIONSHIPWITHOTHERPERSONSIMPLICITLYOREXPLICITLYASSOCIATEDWITHTHETEXT AND ON THE GENERAL CONTENT4HE SAMPLE TEXTS WERE DRAWN FROM A VARIETY OF SITUATIONSTOMAXIMISETHEDIVERSITYOFCONTENTINCLUDEDINTHEREADINGLITERACY SURVEY#LOSEATTENTIONWASALSOPAIDTOTHEORIGINOFTEXTSSELECTEDFORINCLUSION INTHISSURVEY4HEGOALWASTOREACHABALANCEBETWEENTHEBROADDElNITIONOF READINGLITERACYUSEDIN/%#$0)3!ANDTHELINGUISTICANDCULTURALDIVERSITYOF PARTICIPATINGCOUNTRIES4HISDIVERSITYHELPEDTOENSURETHATNOONEGROUPWOULD BEEITHERADVANTAGEDORDISADVANTAGEDBYTHEASSESSMENTCONTENT 4HEFOURSITUATIONVARIABLESTAKENFROMTHEWORKOFTHE#OUNCILOF%UROPECAN BEDESCRIBEDASFOLLOWS s2EADING FOR PRIVATE USE PERSONAL4HIS TYPE OF READING IS CARRIED OUT TO SATISFY AN INDIVIDUALS OWN INTERESTSBOTH PRACTICAL AND INTELLECTUAL)T ALSO INCLUDES READINGTOMAINTAINORDEVELOPPERSONALCONNECTIONSTOOTHERPEOPLE#ONTENTS TYPICALLY INCLUDE PERSONAL LETTERS lCTION BIOGRAPHY AND INFORMATIONAL TEXTS READFORCURIOSITYASAPARTOFLEISUREORRECREATIONALACTIVITIES s2EADINGFORPUBLICUSE4HISTYPEOFREADINGISCARRIEDOUTTOPARTICIPATEINTHE ACTIVITIESOFTHEWIDERSOCIETY)TINCLUDESTHEUSEOFOFlCIALDOCUMENTSASWELL ££n 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ ASINFORMATIONABOUTPUBLICEVENTS)NGENERALTHESETASKSAREASSOCIATEDWITH MOREORLESSANONYMOUSCONTACTWITHOTHERS s2EADINGFORWORKOCCUPATIONAL7HILENOTALLYEAROLDSWILLACTUALLYHAVETO READATWORKITISIMPORTANTTOASSESSTHEIRREADINESSTOMOVEINTOTHEWORLD OFWORKSINCEINMOSTCOUNTRIESOVEROFTHEMWILLBEINTHELABOURFORCE WITHINONETOTWOYEARS4HEPROTOTYPICALTASKSOFTHISTYPEAREOFTENREFERRED TOAShREADINGTODOv3TICHT3TIGGINSINTHATTHEYARETIEDTOTHE ACCOMPLISHMENTOFSOMEIMMEDIATETASK ,i>`}ÊÌiÀ>VÞÊ s2EADINGFOREDUCATION4HISTYPEOFREADINGISNORMALLYINVOLVEDWITHACQUIRING INFORMATION AS PART OF A LARGER LEARNING TASK4HE MATERIALS ARE OFTEN NOT CHOSENBYTHEREADERBUTASSIGNEDBYATEACHER4HECONTENTISUSUALLYDESIGNED SPECIlCALLY FOR THE PURPOSE OF INSTRUCTION4HE PROTOTYPICAL TASKS ARE THOSE USUALLYIDENTIlEDAShREADINGTOLEARNv3TICHT3TIGGINS &IGURE SHOWS THE DISTRIBUTION OF READING LITERACY TASKS IN THE ASSESSMENT ACROSSALLFOURSITUATIONSFORTWOSCENARIOSWHENREADINGWASAMAJORDOMAIN 0)3!ANDWHENITISAMINORDOMAIN0)3!!MOREEVENDISTRIBUTION OFTASKSACROSSSITUATIONSISACHIEVEDIN }ÕÀiÊÓ°xs$ISTRIBUTIONOFREADINGLITERACYTASKSBYSITUATION 2EADINGASAMAJORDOMAIN0)3! 2EADINGASAMINORDOMAIN0)3! 3ITUATION 0ERCENTAGEOFTASKS 0ERSONAL 0UBLIC /CCUPATIONAL %DUCATIONAL 4/4!, 2%0/24).'/54#/-%3 3CALINGTHEREADINGLITERACYTASKS 4HE READING LITERACY TASKS ARE CONSTRUCTED AND ADMINISTERED TO NATIONALLY REPRESENTATIVESAMPLESOFYEAROLDSINPARTICIPATINGCOUNTRIESTOENSURETHAT THE ASSESSMENT PROVIDES THE BROADEST POSSIBLE COVERAGE OF READING LITERACY AS DElNED HERE(OWEVERNO INDIVIDUAL STUDENT CAN BE EXPECTED TO RESPOND TO THEENTIRESETOFTASKS!CCORDINGLYTHESURVEYISDESIGNEDTOGIVEEACHSTUDENT PARTICIPATINGINTHESTUDYASUBSETOFTHETOTALPOOLOFTASKSWHILEATTHESAME TIMEENSURINGTHATEACHOFTHETASKSISADMINISTEREDTONATIONALLYREPRESENTATIVE SAMPLESOFSTUDENTS3UMMARISINGTHEPERFORMANCEOFSTUDENTSACROSSTHISENTIRE POOLOFTASKSTHUSPOSESACHALLENGE ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS ££ ,i>`}ÊÌiÀ>VÞÊ /NE MAY IMAGINE THE READING LITERACY TASKS ARRANGED ALONG A CONTINUUM IN TERMSOFDIFlCULTYFORSTUDENTSANDTHELEVELOFSKILLREQUIREDTOANSWEREACH ITEMCORRECTLY4HEPROCEDUREUSEDIN/%#$0)3!TOCAPTURETHISCONTINUUM OFDIFlCULTYANDABILITYIS)TEM2ESPONSE4HEORY)24)24ISAMATHEMATICAL MODELUSEDFORESTIMATINGTHEPROBABILITYTHATAPARTICULARPERSONWILLRESPOND CORRECTLY TO A GIVEN TASK FROM A SPECIlED POOL OF TASKS4HIS PROBABILITY IS MODELLEDALONGACONTINUUMWHICHSUMMARISESBOTHTHEPROlCIENCYOFAPERSON IN TERMS OF HIS OR HER ABILITY AND THE COMPLEXITY OF AN ITEM IN TERMS OF ITS DIFlCULTY4HISCONTINUUMOFDIFlCULTYANDPROlCIENCYISREFERREDTOASAhSCALEv 2EPORTING 0)3!WILLFOLLOWTHEREPORTINGSCHEMEUSEDIN0)3!WHICHREPORTED OUTCOMES IN TERMS OF A PROlCIENCY SCALE BASED ON THEORY AND INTERPRETABLE IN POLICY TERMS4HE RESULTS OF THE READING LITERACY ASSESSMENT WERE lRST SUMMARISED ON A SINGLE COMPOSITE READING LITERACY SCALE HAVING A MEAN OF AND A STANDARD DEVIATION OF )N ADDITION STUDENT PERFORMANCE WAS ALSOREPRESENTEDONlVESUBSCALESTHREEPROCESSASPECTSUBSCALESRETRIEVING INFORMATIONINTERPRETINGTEXTSANDREmECTIONANDEVALUATION/%#$A ANDTWOTEXTFORMATSUBSCALESCONTINUOUSANDNONCONTINUOUSTEXT/%#$ B4HESE lVE SUBSCALES MAKE IT POSSIBLE TO COMPARE MEAN SCORES AND DISTRIBUTIONS AMONG SUBGROUPS AND COUNTRIES BY VARIOUS COMPONENTS OF THE READINGLITERACYCONSTRUCT!LTHOUGHTHEREISAHIGHCORRELATIONBETWEENTHESE SUBSCALESREPORTINGRESULTSONEACHSUBSCALEMAYREVEALINTERESTINGINTERACTIONS AMONG THE PARTICIPATING COUNTRIES7HERE SUCH FEATURES OCCUR THEY CAN BE EXAMINED AND LINKED TO THE CURRICULUM AND TEACHING METHODOLOGY USED )N SOME COUNTRIES THE IMPORTANT QUESTION MAY BE HOW TO TEACH THE CURRENT CURRICULUMBETTER)NOTHERSTHEQUESTIONMAYNOTONLYBEHOWTOTEACHBUTALSO WHATTOTEACH 4HEREADINGPROCESSASPECTSUBSCALES &IGURESUMMARISESTHEREADINGLITERACYTASKSINTERMSOFTHREEPROCESSES 4HEREARETWOREASONSFORREDUCINGTHENUMBEROFPROCESSSUBSCALESFROMlVETO THREEFORREPORTINGPURPOSES4HElRSTISPRAGMATIC)NANDREADING AS A MINOR DOMAINWILL BE RESTRICTED TO ABOUT ITEMS INSTEAD OF THE THAT WERE USED IN WHEN READING WAS A MAJOR DOMAIN4HE AMOUNT OF INFORMATIONTHEREFOREWILLBEINSUFlCIENTTOREPORTTRENDSOVERlVEPROCESS SUBSCALES4HESECONDREASONISCONCEPTUAL4HETHREEPROCESSSUBSCALESAREBASED ONTHESETOFlVEPROCESSESSHOWNIN&IGURE&ORMINGABROADUNDERSTANDING ANDDEVELOPINGANINTERPRETATIONHAVEBEENGROUPEDTOGETHERINANhINTERPRETING TEXTSvSUBSCALEBECAUSEINBOTHTHEREADERPROCESSESINFORMATIONINTHETEXT INTHECASEOFFORMINGABROADUNDERSTANDINGTHEWHOLETEXTANDINTHECASEOF DEVELOPINGANINTERPRETATIONONEPARTOFTHETEXTINRELATIONTOANOTHER2EmECTING ONANDEVALUATINGTHECONTENTOFATEXTANDREmECTINGONANDEVALUATINGTHEFORMOFATEXT HAVEBEENCOLLAPSEDINTOASINGLEhREmECTIONANDEVALUATIONvSUBSCALEBECAUSETHE DISTINCTIONBETWEENREmECTINGONANDEVALUATINGCONTENTANDREmECTINGONAND EVALUATINGFORMINPRACTICEWASFOUNDTOBESOMEWHATARBITRARY £Óä 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ }ÕÀiÊÓ°Ès2ELATIONSHIPBETWEENTHEREADINGLITERACYFRAMEWORKANDTHE PROCESSASPECTSUBSCALES 2EADING,ITERACY 5SEINFORMATIONPRIMARILY FROMWITHINTHETEXT ,i>`}ÊÌiÀ>VÞÊ $RAWUPONOUTSIDE KNOWLEDGE 2ETRIEVING INFORMATION )NTERPRETING TEXTS 2ETRIEVE INFORMATION &ORMABROAD $EVELOPAN UNDERSTANDING INTERPRETATION 2EmECTIONAND EVALUATION 2EmECT 2EmECT ONAND ONAND EVALUATE EVALUATEFORM CONTENTOFTEXT OFTEXT 4HETEXTFORMATSUBSCALES 0)3! WILL ALSO OFFER THE POSSIBILITY OF PROVIDING RESULTS BASED ON TEXT FORMATSUBSCALESASREPORTEDIN2EADINGFORCHANGE0ERFORMANCEANDENGAGEMENT ACROSSCOUNTRIES/%#$B&IGURESUMMARISESTHEVARIOUSTEXTFORMATS AND THE ASSOCIATED TASKS ALONG THE TWO TEXT FORMAT SUBSCALES/RGANISING THE DATAINTHISWAYPROVIDESTHEOPPORTUNITYTOEXAMINETOWHATEXTENTCOUNTRIES DIFFERWITHRESPECTTOABILITYTODEALWITHTEXTSINDIFFERENTFORMATS)NREPORTING RESULTSFORTWOTHIRDSOFTHETASKSWEREUSEDTOCREATETHECONTINUOUSTEXT SUBSCALEWHILETHEREMAININGONETHIRDOFTHETASKSWEREUSEDTOCREATETHENON CONTINUOUSTEXTSUBSCALE4HEREISASIMILARDISTRIBUTIONOFTASKSBETWEENTHETWO TEXTFORMATSIN }ÕÀiÊÓ°Çs2ELATIONSHIPBETWEENTHEREADINGLITERACYFRAMEWORK ANDTHETEXTFORMATSUBSCALES 2EADING,ITERACY #ONTINUOUSTEXTSs s.ONCONTINUOUSTEXTS .ARRATIVE %XPOSITORY $ESCRIPTIVE !RGUMENTATIVE ANDPERSUASIVE )NJUNCTIVE #HARTSANDGRAPHS 4ABLES $IAGRAMS -APS &ORMS !DVERTISEMENTS ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS £Ó£ ,i>`}ÊÌiÀ>VÞÊ 4HE SCORES ON THE COMPOSITE SCALE AS WELL AS ON EACH OF THE lVE SUBSCALES REPRESENTVARYINGDEGREESOFPROlCIENCY!LOWSCOREINDICATESTHATASTUDENT HASVERYLIMITEDKNOWLEDGEANDSKILLSWHILEAHIGHSCOREINDICATESTHATASTUDENT HASQUITEADVANCEDKNOWLEDGEANDSKILLS5SEOF)TEM2ESPONSE4HEORYMAKESIT POSSIBLENOTONLYTOSUMMARISERESULTSFORVARIOUSSUBPOPULATIONSOFSTUDENTS BUTALSOTODETERMINETHERELATIVEDIFlCULTYOFTHEREADINGLITERACYTASKSINCLUDED INTHESURVEY)NOTHERWORDSJUSTASINDIVIDUALSRECEIVEASPECIlCVALUEONA SCALEACCORDINGTOTHEIRPERFORMANCEINTHEASSESSMENTTASKSEACHTASKRECEIVES A SPECIlC VALUE ON A SCALE ACCORDING TO ITS DIFlCULTY AS DETERMINED BY THE PERFORMANCE OF STUDENTS ACROSS THE VARIOUS COUNTRIES THAT PARTICIPATE IN THE ASSESSMENT "UILDINGANITEMMAP 4HE COMPLETE SET OF READING LITERACY TASKS USED IN /%#$0)3! VARIES WIDELY IN TEXT FORMATSITUATION AND TASK REQUIREMENTSAND HENCE ALSO IN DIFFICULTY4HIS RANGE IS CAPTURED THROUGH WHAT IS KNOWN AS AN ITEM MAP 4HEITEMMAPPROVIDESAVISUALREPRESENTATIONOFTHEREADINGLITERACYSKILLS DEMONSTRATEDBYSTUDENTSALONGTHESCALES4HEMAPSHOULDCONTAINABRIEF DESCRIPTION OF A SELECTED NUMBER OF RELEASED ASSESSMENT TASKS ALONG WITH THEIR SCALE VALUES4HESE DESCRIPTIONS TAKE INTO CONSIDERATION THE SPECIFIC SKILLS THE ITEM IS DESIGNED TO ASSESS ANDIN THE CASE OF OPENENDED TASKS THE CRITERIA USED FOR JUDGING THE ITEM CORRECT !N EXAMINATION OF THE DESCRIPTIONSPROVIDESSOMEINSIGHTINTOTHERANGEOFPROCESSESREQUIREDOF STUDENTSANDTHEPROFICIENCIESTHEYNEEDTODEMONSTRATEATVARIOUSPOINTS ALONGTHEREADINGLITERACYSCALES &IGURESHOWSANEXAMPLEOFANITEMMAPFROM0)3!!NEXPLANATION OFHOWTOINTERPRETITMAYBEUSEFUL4HESCOREASSIGNEDTOEACHITEMISBASED ONTHETHEORYTHATSOMEONEATAGIVENPOINTONTHESCALEISEQUALLYPROlCIENT IN ALL TASKS AT THAT POINT ON THE SCALE)T WAS DECIDED THATFOR THE PURPOSES OF/%#$0)3!hPROlCIENCYvSHOULDMEANTHATSTUDENTSATAPARTICULARPOINT ONTHEREADINGLITERACYSCALEWOULDHAVEAPERCENTCHANCEOFRESPONDING CORRECTLY TO ITEMS AT THAT POINT&OR EXAMPLEIN &IGURE AN ITEM APPEARS AT ON THE COMPOSITE SCALE4HIS MEANS THAT STUDENTS SCORING ON THE COMPOSITE READING LITERACY SCALE WILL HAVE A PER CENT CHANCE OF CORRECTLY ANSWERING ITEMS GRADED ON THE SCALE4HIS DOES NOT MEAN THAT STUDENTS RECEIVING SCORES BELOW WILL ALWAYS ANSWER INCORRECTLY 2ATHER STUDENTS SCORINGBELOWWILLBEEXPECTEDTOANSWERCORRECTLYANITEMOFTHATLEVELOF DIFlCULTYLESSTHANPERCENTOFTHETIME#ONVERSELYSTUDENTSHAVINGSCORES ABOVEWILLHAVEAGREATERTHANPERCENTCHANCEOFRESPONDINGCORRECTLY )T SHOULD BE NOTED THAT THE ITEM WILL ALSO APPEAR ON A PROCESS SUBSCALE AND ONAFORMATSUBSCALEASWELLASONTHECOMBINEDREADINGLITERACYSCALE)NTHIS EXAMPLETHEITEMATONTHECOMPOSITESCALEREQUIRESSTUDENTSTOIDENTIFY THEPURPOSETHATTWOSHORTTEXTSHAVEINCOMMONBYCOMPARINGTHEMAINIDEAS INEACHOFTHEM)TISANINTERPRETATIONITEMANDTHUSAPPEARSONTHEINTERPRETING TEXTSSCALEASWELLASONTHECONTINUOUSTEXTSSCALE £ÓÓ 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ }ÕÀiÊÓ°ns!NEXAMPLEOFA0)3!ITEMMAP 4YPESOF0ROCESS h5hh 4YPESOF0ROCESS!SPECT !SPECT 2ETRieVING )NFORMATION )NTERPRETING 2EmECTINGAND EVALUATING #ONTINUOUS .ONCONTINUOUS s4EXT&ORMAT 4EXT &ORMAT (90/4(%3)3%ABOUTANUNEXPECTEDPHENOMENONBY 5 s !.!,93%SEVERALDESCRIBEDCASESAND-!4#(TO CATEGORIESGIVENINA42%%$)!'2!-WHERESOMEOFTHE 5 s (90/4(%3)3%ABOUTANUNEXPECTEDPHENOMENON BYTAKINGACCOUNTOFOUTSIDEKNOWLEDGEALONGWITHSOME RELEVANTINFORMATIONINA#/-0,%84!",%ONARELATIVELY UNFAMILIARTOPICSCORE 5 s %6!,5!4%THEENDINGOFA,/.'.!22!4)6%INRELATION TOITSIMPLICITTHEMEORMOODSCORE 5 s 2%,!4%.5!.#%3/&,!.'5!'%INA,/.'.!22!4)6% 5 s 5 #/.3425%THEMEANINGOFASENTENCEBYRELATINGITTO BROADCONTEXTINA,/.'.!22!4)6% 5 s (90/4(%3)3%ABOUTANAUTHORIALDECISIONBYRELATING EVIDENCEINAGRAPHTOTHEINFERREDMAINTHEMEOF -5,4)0,%'2!0()#$)30,!93 5 s #/-0!2%!.$%6!,5!4%THESTYLEOFTWOOPEN,%44%23 5 s s 5 s 5 5 s SITUATIONSCORE #/..%#4EVIDENCEFROMA,/.'.!22!4)6%TOPERSONAL CONCEPTSINORDERTOJUSTIFYOPPOSINGPOINTSOFVIEWSCORE 5 s #OMPOSITEITEMMAP TAKINGACCOUNTOFOUTSIDEKNOWLEDGEALONGWITHALLRELEVANT INFORMATIONINA#/-0,%84!",%ONARELATIVELYUNFAMILIAR TOPICSCORE ,i>`}ÊÌiÀ>VÞÊ RELEVANTINFORMATIONISINFOOTNOTESSCORE TOTHEMAINTHEMEINTHEPRESENCEOFCONmICTINGIDEASSCORE ,/#!4%INFORMATIONINA42%%$)!'2!-USING INFORMATIONINAFOOTNOTESCORE %6!,5!4%THEENDINGOFA,/.'.!22!4)6%INRELATION TOTHEPLOTSCORE ).&%2!.!.!,/')#!,2%,!4)/.3()0BETWEENTWO PHENOMENADISCUSSEDINANOPEN,%44%2 )$%.4)&9THEIMPLIEDSTARTINGDATEOFA'2!0( #/.3425%4(%-%!.).'OFSHORTQUOTATIONSFROM A,/.'.!22!4)6%INRELATIONTOATMOSPHEREORIMMEDIATE 5 s s x ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS £ÓÎ }ÕÀiÊÓ°nÊVÌÕi`®s!NEXAMPLEOFA0)3!ITEMMAP !SPECT 4EXT &ORMAT #ONTINUOUS %80,!).ACHARACTERSMOTIVATIONBYLINKINGEVENTS INA,/.'.!22!4)6% 5 s ).&%24(%2%,!4)/.3()0BETWEEN 47/'2!0()#$)30,!93WITHDIFFERENTCONVENTIONS 5 s %6!,5!4%THESUITABILITYOFA42%%$)!'2!- FORPARTICULARPURPOSES 5 s 5 s 5 s 5 s 5 s -!4#(CATEGORIESGIVENINA42%%$)!'2!-TODESCRIBEDCASES WHENSOMEOFTHERELEVANTINFORMATIONISINFOOTNOTESSCORE 5 s ).4%202%4INFORMATIONINASINGLEPARAGRAPHTO UNDERSTANDTHESETTINGOFA.!22!4)6% 5 s $ISTINGUISHBETWEENVARIABLESAND 3425#452!,&%!452%3OFA42%%$)!'2!- 5 )$%.4)&9THECOMMON0520/3%OF47/3(/244%843 5 s 5 s 5 ,/#!4%ALITERALPIECEOFINFORMATIONINA4%84WITH CLEARTEXTSTRUCTURE 5 s ,/#!4%EXPLICITINFORMATIONINASHORTSPECIlED SECTIONOFA.!22!4)6% 5 s ,/#!4%ANEXPLICITLYSTATEDPIECEOFINFORMATIONIN A4%84WITHHEADINGS 5 s 5 s ,/#!4%NUMERICALINFORMATIONINA42%%$)!'2!-SCORE #/..%#4EVIDENCEFROMA,/.'.!22!4)6%TOPERSONAL CONCEPTSINORDERTOJUSTIFYASINGLEPOINTOFVIEWSCORE ,/#!4%!.$#/-").%INFORMATIONINA,).%'2!0( ANDITSINTRODUCTIONTOINFERAMISSINGVALUE 5.$%234!.$THESTRUCTUREOFA42%%$)!'2!- ,/#!4%PIECESOFEXPLICITINFORMATIONINA4%84 CONTAININGSTRONGORGANIZERS )NFERTHE-!).)$%!OFASIMPLE"!2'2!0(FROMITSTITLE 2%#/'.)3%4(%-%OFANARTICLEHAVINGACLEAR SUBHEADINGANDCONSIDERABLEREDUNDANCY )NTERPRETING 2EmECTINGAND EVALUATING s4EXT&ORMAT #OMPOSITEITEMMAP £Ó{ 4YPESOF0ROCESS .ONCONTINUOUS h5hh 4YPESOF0ROCESS!SPECT 2ETRieVING )NFORMATION ,i>`}ÊÌiÀ>VÞÊ 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ s s ,EVELSOFREADINGLITERACYPROlCIENCY *USTASSTUDENTSWITHINEACHCOUNTRYARESAMPLEDTOREPRESENTTHENATIONALPOPULATION OFYEAROLDSTUDENTSEACHREADINGLITERACYTASKREPRESENTSACLASSOFTASKSFROM THEREADINGLITERACYDOMAIN(ENCEITREPRESENTSPROlCIENCYINATYPEOFPROCESSING ANDINDEALINGWITHATYPEOFTEXTTHATYEAROLDSTUDENTSSHOULDHAVEACQUIRED /NEOBVIOUSQUESTIONISWHATDISTINGUISHESTASKSATTHELOWERENDOFTHESCALEFROM THOSEINTHEMIDDLEANDUPPERRANGESOFTHESCALE!LSODOTASKSTHATFALLAROUND THESAMEPLACEONTHESCALESHARESOMECHARACTERISTICSTHATRESULTINTHEIRHAVING SIMILARLEVELSOFDIFlCULTY%VENACURSORYREVIEWOFTHEITEMMAPREVEALSTHATTASKS ATTHELOWERENDOFEACHSCALEDIFFERFROMTHOSEATTHEHIGHEREND!MORECAREFUL ANALYSISOFTHERANGEOFTASKSALONGEACHSCALEPROVIDESINDICATIONSOFANORDERED SETOFINFORMATIONPROCESSINGSKILLSANDSTRATEGIES-EMBERSOFTHEREADINGEXPERT GROUPEXAMINEDEACHTASKTOIDENTIFYASETOFVARIABLESTHATSEEMEDTOINmUENCEITS DIFlCULTY4HEYFOUNDTHATDIFlCULTYISINPARTDETERMINEDBYTHELENGTHSTRUCTURE ANDCOMPLEXITYOFTHETEXTITSELF(OWEVERTHEYALSONOTEDTHATINMOSTREADING UNITSAUNITBEINGATEXTANDASETOFQUESTIONSTHEQUESTIONSRANGEACROSSTHE READINGLITERACYSCALE4HISMEANSTHATWHILETHESTRUCTUREOFATEXTCONTRIBUTESTO THEDIFlCULTYOFANITEMWHATTHEREADERHASTODOWITHTHATTEXTASDElNEDBYTHE QUESTIONORDIRECTIVEINTERACTSWITHTHETEXTANDAFFECTSTHEOVERALLDIFlCULTY ,i>`}ÊÌiÀ>VÞÊ 4HEMEMBERSOFTHEREADINGEXPERTGROUPANDTESTDEVELOPERSIDENTIlEDANUMBER OFVARIABLESTHATCANINmUENCETHEDIFlCULTYOFANYREADINGLITERACYTASK/NESALIENT FACTORISTHEPROCESSINVOLVEDINRETRIEVINGINFORMATIONDEVELOPINGANINTERPRETATION ORREmECTINGONWHATHASBEENREAD0ROCESSESRANGEINCOMPLEXITYANDSOPHISTICATION FROM MAKING SIMPLE CONNECTIONS BETWEEN PIECES OF INFORMATIONTO CATEGORISING IDEASACCORDINGTOGIVENCRITERIAANDTOCRITICALLYEVALUATINGANDHYPOTHESISINGABOUT ASECTIONOFTEXT)NADDITIONTOTHEPROCESSCALLEDFORTHEDIFlCULTYOFRETRIEVING INFORMATIONTASKSVARIESWITHTHENUMBEROFPIECESOFINFORMATIONTOBEINCLUDEDIN THERESPONSETHENUMBEROFCRITERIAWHICHTHEINFORMATIONMUSTSATISFYANDWHETHER ORNOTWHATISRETRIEVEDNEEDSTOBESEQUENCEDINAPARTICULARWAY)NTHECASEOF INTERPRETATIVEANDREmECTIVETASKSTHEAMOUNTOFATEXTTHATNEEDSTOBEASSIMILATED IS AN IMPORTANT FACTOR AFFECTING DIFlCULTY)N ITEMS THAT REQUIRE REmECTION ON THE READERSPARTDIFlCULTYISALSOCONDITIONEDBYTHEFAMILIARITYORSPECIlCITYOFTHE KNOWLEDGETHATMUSTBEDRAWNONFROMOUTSIDETHETEXT)NALLPROCESSESOFREADING THEDIFlCULTYOFTHETASKDEPENDSONHOWPROMINENTTHEREQUIREDINFORMATIONISHOW MUCHCOMPETINGINFORMATIONISPRESENTANDWHETHERORNOTTHEREADERISEXPLICITLY DIRECTEDTOTHEIDEASORINFORMATIONREQUIREDTOCOMPLETETHETASK )NANATTEMPTTOCAPTURETHISPROGRESSIONOFCOMPLEXITYANDDIFlCULTYIN0)3! THECOMPOSITEREADINGLITERACYSCALEANDEACHOFTHESUBSCALESWEREDIVIDEDINTO lVELEVELS ,EVEL 3COREPOINTSONTHE0)3!SCALE TO TO TO TO -ORETHAN ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS £Óx ,i>`}ÊÌiÀ>VÞÊ %XPERTPANELSJUDGEDTHATTHETASKSWITHINEACHLEVELOFREADINGLITERACYSHARED MANY OF THE SAME TASK FEATURES AND REQUIREMENTSAND DIFFERED IN SYSTEMATIC WAYS FROM TASKS AT HIGHER OR LOWER LEVELS!S A RESULTTHESE LEVELS APPEAR TO BEAUSEFULWAYTOEXPLORETHEPROGRESSIONOFREADINGLITERACYDEMANDSWITHIN EACHSCALE4HISPROGRESSIONISSUMMARISEDIN&IGURE4HISPROCESSWILLBE REPEATEDFORTHEMAJORDOMAINSFOREACHCYCLE }ÕÀiÊÓ°s2EADINGLITERACYLEVELSMAP 2ETRIEVINGINFORMATION )NTERPRETINGTEXTS 2EmECTINGANDEVALUATING ,OCATEANDPOSSIBLYSEQUENCE ORCOMBINEMULTIPLEPIECESOF DEEPLYEMBEDDEDINFORMATION SOMEOFWHICHMAYBEOUTSIDE THEMAINBODYOFTHETEXT)NFER WHICHINFORMATIONINTHETEXTIS RELEVANTTOTHETASK$EALWITH HIGHLYPLAUSIBLEANDOREXTENSIVE COMPETINGINFORMATION %ITHERCONSTRUETHEMEANINGOF NUANCEDLANGUAGEORDEMONSTRATE AFULLANDDETAILEDUNDERSTANDING OFATEXT #RITICALLYEVALUATEOR HYPOTHESISEDRAWINGON SPECIALISEDKNOWLEDGE$EAL WITHCONCEPTSTHATARECONTRARY TOEXPECTATIONSANDDRAWONA DEEPUNDERSTANDINGOFLONGOR COMPLEXTEXTS #ONTINUOUSTEXTS.EGOTIATETEXTSWHOSEDISCOURSESTRUCTUREISNOTOBVIOUSORCLEARLYMARKEDINORDER TODISCERNTHERELATIONSHIPOFSPECIlCPARTSOFTHETEXTTOITSIMPLICITTHEMEORINTENTION .ONCONTINUOUSTEXTS )DENTIFYPATTERNSAMONGMANYPIECESOFINFORMATIONPRESENTEDINADISPLAY WHICHMAYBELONGANDDETAILEDSOMETIMESBYREFERRINGTOINFORMATIONEXTERNALTOTHEDISPLAY4HE READER MAY NEED TO REALISE INDEPENDENTLY THAT A FULL UNDERSTANDING OF THE SECTION OF TEXT REQUIRES REFERENCETOASEPARATEPARTOFTHESAMEDOCUMENTSUCHASAFOOTNOTE ,OCATEANDPOSSIBLYSEQUENCEOR COMBINEMULTIPLEPIECESOF EMBEDDEDINFORMATIONEACHOF WHICHMAYNEEDTOMEETMULTIPLE CRITERIAINATEXTWITHFAMILIAR CONTEXTORFORM)NFERWHICH INFORMATIONINTHETEXTISRELEVANT TOTHETASK 5SEAHIGHLEVELOFTEXTBASED INFERENCETOUNDERSTANDANDAPPLY CATEGORIESINANUNFAMILIAR CONTEXTANDTOCONSTRUETHE MEANINGOFASECTIONOFTEXTBY TAKINGINTOACCOUNTTHETEXTAS AWHOLE$EALWITHAMBIGUITIES IDEASTHATARECONTRARYTO EXPECTATIONANDIDEASTHATARE NEGATIVELYWORDED 5SEFORMALORPUBLICKNOWLEDGE TOHYPOTHESISEABOUTORCRITICALLY EVALUATEATEXT3HOWACCURATE UNDERSTANDINGOFLONGOR COMPLEXTEXTS #ONTINUOUSTEXTS&OLLOWLINGUISTICORTHEMATICLINKSOVERSEVERALPARAGRAPHSOFTENINTHEABSENCEOF CLEARDISCOURSEMARKERSINORDERTOLOCATEINTERPRETOREVALUATEEMBEDDEDINFORMATIONORTOINFER PSYCHOLOGICALORMETAPHYSICALMEANING .ONCONTINUOUSTEXTS 3CANALONGDETAILEDTEXTINORDERTOlNDRELEVANTINFORMATIONOFTENWITH LITTLEORNOASSISTANCEFROMORGANISERSSUCHASLABELSORSPECIALFORMATTINGTOLOCATESEVERALPIECESOF INFORMATIONTOBECOMPAREDORCOMBINED £ÓÈ 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ }ÕÀiÊÓ°ÊVÌÕi`®s2EADINGLITERACYLEVELSMAP 2ETRIEVINGINFORMATION ,OCATEANDINSOMECASESRECOGNISE THERELATIONSHIPBETWEENPIECESOF INFORMATIONEACHOFWHICHMAY NEEDTOMEETMULTIPLECRITERIA $EALWITHPROMINENTCOMPETING INFORMATION )NTERPRETINGTEXTS 2EmECTINGANDEVALUATING )NTEGRATESEVERALPARTSOFATEXT INORDERTOIDENTIFYAMAIN IDEAUNDERSTANDARELATIONSHIPOR CONSTRUETHEMEANINGOFAWORD ORPHRASE#OMPARECONTRASTOR CATEGORISETAKINGMANYCRITERIA INTOACCOUNT$EALWITHCOMPETING INFORMATION -AKECONNECTIONSOR COMPARISONSGIVEEXPLANATIONS OREVALUATEAFEATUREOFTEXT $EMONSTRATEADETAILED UNDERSTANDINGOFTHETEXTIN RELATIONTOFAMILIAREVERYDAY KNOWLEDGEORDRAWONLESS COMMONKNOWLEDGE ,i>`}ÊÌiÀ>VÞÊ #ONTINUOUSTEXTS5SECONVENTIONSOFTEXTORGANISATIONWHEREPRESENTANDFOLLOWIMPLICITOREXPLICIT LOGICALLINKSSUCHASCAUSEANDEFFECTRELATIONSHIPSACROSSSENTENCESORPARAGRAPHSINORDERTOLOCATE INTERPRETOREVALUATEINFORMATION .ONCONTINUOUSTEXTS#ONSIDERONEDISPLAYINTHELIGHTOFASECONDSEPARATEDOCUMENTORDISPLAY POSSIBLYINADIFFERENTFORMATORCOMBINESEVERALPIECESOFSPATIALVERBALANDNUMERICINFORMATIONIN AGRAPHORMAPTODRAWCONCLUSIONSABOUTTHEINFORMATIONREPRESENTED ,OCATEONEORMOREPIECESOF INFORMATIONEACHOFWHICHMAYBE REQUIREDTOMEETMULTIPLECRITERIA $EALWITHCOMPETINGINFORMATION )DENTIFYTHEMAINIDEAINATEXT UNDERSTANDRELATIONSHIPSFORMOR APPLYSIMPLECATEGORIESOR CONSTRUEMEANINGWITHINALIMITED PARTOFTHETEXTWHENTHE INFORMATIONISNOTPROMINENTAND LOWLEVELINFERENCESAREREQUIRED -AKEACOMPARISONOR CONNECTIONSBETWEENTHETEXT ANDOUTSIDEKNOWLEDGEOR EXPLAINAFEATUREOFTHETEXTBY DRAWINGONPERSONALEXPERIENCE ANDATTITUDES #ONTINUOUSTEXTS&OLLOWLOGICALANDLINGUISTICCONNECTIONSWITHINAPARAGRAPHINORDERTOLOCATEOR INTERPRETINFORMATIONORSYNTHESISEINFORMATIONACROSSTEXTSORPARTSOFATEXTINORDERTOINFERTHE AUTHORSPURPOSE .ONCONTINUOUSTEXTS$EMONSTRATEAGRASPOFTHEUNDERLYINGSTRUCTUREOFAVISUALDISPLAYSUCHASA SIMPLETREEDIAGRAMORTABLEORCOMBINETWOPIECESOFINFORMATIONFROMAGRAPHORTABLE ,OCATEONEORMOREINDEPENDENT PIECESOFEXPLICITLYSTATED INFORMATIONTYPICALLYMEETINGA SINGLECRITERIONWITHLITTLEORNO COMPETINGINFORMATIONINTHETEXT 2ECOGNISETHEMAINTHEMEOR AUTHORSPURPOSEINATEXTABOUTA FAMILIARTOPICWHENTHEREQUIRED INFORMATIONINTHETEXTISNOT PROMINENT -AKEASIMPLECONNECTION BETWEENINFORMATIONINTHETEXT ANDCOMMONEVERYDAY KNOWLEDGE #ONTINUOUS TEXTS 5SE REDUNDANCYPARAGRAPH HEADINGS OR COMMON PRINT CONVENTIONS TO FORM AN IMPRESSIONOFTHEMAINIDEAOFTHETEXTORTOLOCATEINFORMATIONSTATEDEXPLICITLYWITHINASHORTSECTION OFTEXT .ONCONTINUOUS TEXTS &OCUSONDISCRETEPIECESOFINFORMATIONUSUALLYWITHINASINGLEDISPLAYSUCH AS A SIMPLE MAPA LINE GRAPH OR A BAR GRAPH THAT PRESENTS ONLY A SMALL AMOUNT OF INFORMATION IN A STRAIGHTFORWARD WAYAND IN WHICH MOST OF THE VERBAL TEXT IS LIMITED TO A SMALL NUMBER OF WORDS OR PHRASES ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS £ÓÇ ,i>`}ÊÌiÀ>VÞÊ )NTERPRETINGTHEREADINGLITERACYLEVELS .OTONLYDOESEACHLEVELREPRESENTARANGEOFTASKSANDASSOCIATEDKNOWLEDGE ANDSKILLSITALSOREPRESENTSARANGEOFPROlCIENCIESDEMONSTRATEDBYSTUDENTS !S MENTIONED PREVIOUSLYTHE READING LITERACY LEVELS WERE INITIALLY SET BY THE MEMBERSOFTHEREADINGEXPERTGROUPTOREPRESENTASETOFTASKSWITHSHARED CHARACTERISTICS4HESELEVELSALSOHAVESHAREDSTATISTICALPROPERTIES4HEAVERAGE STUDENTWITHINEACHLEVELCANBEEXPECTEDTOSUCCESSFULLYPERFORMTHEAVERAGE TASKWITHINTHATLEVELPERCENTOFTHETIME)NADDITIONTHEWIDTHOFEACHLEVEL ISINPARTDETERMINEDBYTHEEXPECTATIONTHATASTUDENTATTHELOWERENDOFANY LEVELWILLSCOREPERCENTONANYHYPOTHETICALTESTMADEUPOFITEMSRANDOMLY SELECTEDFROMTHATLEVEL 3INCEEACHREADINGLITERACYSCALEREPRESENTSAPROGRESSIONOFKNOWLEDGEANDSKILLS STUDENTS AT A PARTICULAR LEVEL NOT ONLY DEMONSTRATE THE KNOWLEDGE AND SKILLS ASSOCIATEDWITHTHATPARTICULARLEVELBUTTHEPROlCIENCIESASSOCIATEDWITHTHELOWER LEVELSASWELL4HUSTHEKNOWLEDGEANDSKILLSASSUMEDATEACHLEVELBUILDONAND ENCOMPASSTHEPROlCIENCIESLAIDDOWNINTHENEXTLOWERLEVEL4HISMEANSTHATA STUDENTWHOISJUDGEDTOBEAT,EVELONAREADINGLITERACYSCALEISPROlCIENTNOT ONLYIN,EVELTASKSBUTALSOIN,EVELANDTASKS4HISALSOMEANSTHATSTUDENTS WHOAREAT,EVELSANDWILLBEEXPECTEDTOGETTHEAVERAGE,EVELITEMCORRECT LESSTHANPERCENTOFTHETIME0UTANOTHERWAYTHEYWILLBEEXPECTEDTOSCORE LESSTHANPERCENTONATESTMADEUPOFITEMSDRAWNFROM,EVEL &IGURESHOWSTHEPROBABILITYTHATINDIVIDUALSPERFORMINGATSELECTEDPOINTS ALONGTHECOMBINEDREADINGLITERACYSCALEWILLGIVEACORRECTRESPONSETOTASKSOF VARYINGDIFlCULTY/NEISA,EVELTASKONEISA,EVELTASKANDTHETHIRDTASK RECEIVESTWOSCOREPOINTSONEAT,EVELANDTHEOTHERAT,EVEL)TISREADILY SEENHERETHATASTUDENTWITHASCOREOFWHOISESTIMATEDTOBEBELOW,EVEL HASONLYAPERCENTCHANCEOFRESPONDINGCORRECTLYTOTHE,EVELTASKTHAT ISATONTHEREADINGLITERACYSCALE4HISPERSONHASONLYAPERCENTCHANCE OFRESPONDINGTOTHEITEMFROM,EVELANDALMOSTNOCHANCEOFRESPONDING CORRECTLYTOTHEITEMFROM,EVEL3OMEONEWITHAPROlCIENCYOFINTHE MIDDLEOF,EVELHASAPERCENTCHANCEOFRESPONDINGTOTHEITEMAT BUTONLYSLIGHTLYMORETHANONECHANCEINFOUROFRESPONDINGCORRECTLYTOTHE TASKATANDONLYASEVENPERCENTCHANCEOFRESPONDINGCORRECTLYTOTHETASK SELECTEDFROM,EVEL)NCONTRASTSOMEONEAT,EVELWOULDBEEXPECTEDTO RESPONDCORRECTLYPERCENTOFTHETIMETOTASKSATONTHEREADINGLITERACY SCALEAND PER CENT OF THE TIME TO TASKS AT NEAR THE MIDDLE OF ,EVEL (OWEVERHEORSHEWOULDONLYHAVEJUSTOVERONECHANCEINFOURPER CENTOFCORRECTLYRESPONDINGTOITEMSFROMTHEMIDDLEOF,EVEL&INALLYA STUDENTAT,EVELISEXPECTEDTORESPONDCORRECTLYMOSTOFTHETIMETOMOST OFTHETASKS!SSHOWNIN&IGUREASTUDENTHAVINGASCOREOFONTHE COMBINEDREADINGLITERACYSCALEHASAPERCENTCHANCEOFANSWERINGTHETASK ATCORRECTLYAPERCENTCHANCEOFANSWERINGTHEITEMAT,EVEL CORRECTLYANDAPERCENTOFRESPONDINGCORRECTLYTOTHETASKSELECTEDFROM NEARTHECENTREOF,EVEL £Ón 4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS©/%#$ }ÕÀiÊÓ°£äs0ROBABILITYASAPERCENTAGEOFRESPONDINGCORRECTLYTOSELECTEDTASKS OFVARYINGDIFlCULTYFORSTUDENTSWITHVARYINGLEVELSOFPROlCIENCY ,EVELITEM ,EVELITEM ,EVELITEM ,EVELITEM ATPOINTS ATPOINTS ATPOINTS ATPOINTS "ELOW,EVEL ,EVEL ,EVEL ,EVEL ,EVEL ,EVEL 0ROlCIENCYOFPOINTS 0ROlCIENCYOFPOINTS 0ROlCIENCYOFPOINTS 0ROlCIENCYOFPOINTS 0ROlCIENCYOFPOINTS 0ROlCIENCYOFPOINTS ,i>`}ÊÌiÀ>VÞÊ &IGURE ALSO IMPLICITLY RAISES QUESTIONS CONCERNING THE HIGHEST AND LOWEST DESIGNATEDLEVELS%VENTHOUGHTHETOPOFTHEREADINGLITERACYSCALEISUNBOUNDED ITCANBESTATEDWITHSOMECERTAINTYTHATSTUDENTSOFEXTREMELYHIGHPROlCIENCYARE CAPABLEOFPERFORMINGTASKSCHARACTERISEDBYTHEHIGHESTLEVELOFPROlCIENCY4HERE ISMOREOFANISSUEFORSTUDENTSWHOAREATTHEBOTTOMENDOFTHEREADINGLITERACY SCALE,EVELBEGINSATYETACERTAINPERCENTAGEOFSTUDENTSINEACHCOUNTRYIS ESTIMATEDTOBEBELOWTHISPOINTONTHESCALE7HILETHEREARENOREADINGLITERACY TASKSWITHASCALEVALUEBELOWITISNOTCORRECTTOSAYTHATTHESESTUDENTSARE WITHOUTANYREADINGLITERACYSKILLSORAREhTOTALLYILLITERATEv(OWEVERONTHEBASIS OF THEIR PERFORMANCE IN THE SET OF TASKS USED IN THIS ASSESSMENTTHEY WOULD BE EXPECTEDTOSCORELESSTHANPERCENTONASETOFTASKSSELECTEDFROM,EVEL4HEY ARECLASSIlEDTHEREFOREASPERFORMINGBELOW,EVEL 3INCECOMPARATIVELYFEWYOUNGADULTSINOURSOCIETIESHAVENOLITERACYSKILLSTHE FRAMEWORKDOESNOTCALLFORAMEASUREOFWHETHERORNOTYEAROLDSTUDENTS CANREADINATECHNICALSENSE4HATIS/%#$0)3!DOESNOTMEASURETHEEXTENT TOWHICHYEAROLDSTUDENTSAREmUENTREADERSORHOWCOMPETENTTHEYAREAT WORDRECOGNITIONTASKSORSPELLING)TDOESHOWEVERREmECTTHECONTEMPORARY VIEWTHATSTUDENTSSHOULDUPONCOMPLETINGCOMPULSORYEDUCATIONBEABLETO CONSTRUCTEXTENDANDREmECTONTHEMEANINGOFWHATTHEYHAVEREADACROSSA WIDERANGEOFCONTINUOUSANDNONCONTINUOUSTEXTSCOMMONLYASSOCIATEDWITHA VARIETYOFSITUATIONSBOTHWITHINANDOUTSIDESCHOOL7HILEITWASNOTPOSSIBLETO SAYWHATKNOWLEDGEANDSKILLSSTUDENTSPERFORMINGBELOW,EVELMAYPOSSESS WITH REGARD TO READING LITERACYTHEIR LEVEL OF PROlCIENCY INDICATES THAT THESE STUDENTSAREUNLIKELYTOBEABLETOUSEREADINGINDEPENDENTLYASATOOLTOASSIST THEMINACQUIRINGKNOWLEDGEANDSKILLSINOTHERAREASn\ ©/%#$4HE0)3!!SSESSMENT&RAMEWORKn-ATHEMATICS2EADING3CIENCEAND0ROBLEM3OLVING+NOWLEDGEAND3KILLS £Ó

i>`ˆ˜}Ê ˆÌiÀ>VÞ

Related documents

Products

Support

i>`ˆ˜}Ê ˆÌiÀ>VÞ

Related documents

Add this document to collection(s)

Add this document to saved

Suggest us how to improve StudyLib