Assessment Framework A structured process of evidence collection of a person’s competencies and evaluated against an agreed criteria and evaluating the competence of the learner with respect to the occupational standards or learning objectives. This structured process involves following steps: Identifying Gathering of information Interpreting information Competency is cluster of related knowledge, skills and attitude that affects a major part of one’s job and can be measured against well-accepted standards and can be improved via training and development. In short a demonstrated ability to apply the relevant knowledge into action, which is skill and attitude. Learning domain knowledge - Cognitive skill Psychomotor Attitude Affective Assessment is done through range of methods: Tests Observation Interview Assignments Professional discussion Assessment Methods: Knowledge Assessment Method THEORY TEST & VIVA Written test Identification Pictorial Completion /fill in the blanks Short answer question Matching Multiple choice True / False Assessment type Summative assessment Weightage criteria 25% Maximum marks* skill Assessment Method PRACTICAL CAPABILITY & VIVA Direct performance observation Laboratory / skill lab Simulated work situation Spotting Identification Indirect performance observation Video Third party observation Computer aided assessment Assessment type Formative assessment Summative assessment RPL[recognition of prior learning] Weightage criteria 75% Maximum marks* 1 PC = 1 question 1 question carries 2 marks [ 50x2]= 100 2 NOS 1 NOS is equal to 100 200 [ including viva] [2x100] = 200 Passing criteria* Passing criteria* 50% of maximum marks : 50 Candidate should pass in theory paper separately 80% of maximum marks including viva : Candidate should pass in each NOS separately with 80 qualifying marks Assessment parameters Knowledge of equipment/tools/materials Assessment parameters Precision while Attitude Assessment Method PERFORMANCE & BEHAVIOUR Direct observation of Work being done Care of safety, neatness Corrective steps being taken Work habits Approach towards accuracy & precision Manners towards others [co – workers & supervisor] Assessment type Summative assessment Oral test Maximum marks* All 13 NOS grouped under soft skill 1 NOS is equal to 100 [1x100]= 100 Passing criteria* 80% of maximum marks including viva: 80 Assessment parameters Towards the Knowledge of limitation of use of particular tools/equipment Knowledge of methods of procedure Understanding of functioning of equipment/tools Understanding of criteria to be used in selecting tool for a given task Understanding of the process of measurement Through knowledge of essentials to perform the job Knowledge of services supposed to be rendered Identification of patient need and way to satisfy it recording measurement Manipulative skills to handle tools & equipment Ability to apply related knowledge to practical jobs Speed and sequence of performance Observing safety and work precaution Observing patient safety Degree of Accuracy Quality of work done Amount of work done within stipulated time No. of attempts made to do the work Application of knowledge into action under certain circumstances Communication skill which involves listening ability and affective communication to patient and other concerned person so they understand what it is meant to be Communication through phone/mobile Demonstrate and use of caring response Use of series of caring response and create memorable experience Building relationship with patient work Regarding appreciation for accurate & precise work Towards safety/safe working practice Neatness and hygiene Towards coworkers and supervisors Ability to follow manual/written instruction simultaneously Positive attitude – dedication to getting it right Ability to pay attention to detail to retain patient Ability to stay calm under pressure Maintaining premises clean,hygenic & comfortable Tendency to use correct working habits Duration of theory exam 1 hour 30 minutes Duration of practical exam 30 minutes Duration of viva exam 15 minutes Type of question It should be restricted to the essential knowledge without which the person must not be able to do the job. Question should cover at least fifty performance criteria [PC] out of all the PCs Learning objective should match with PC based question. Question paper will be computerized. Should be of objective type [MCQ] involving selection of correct response rather than writing sentences Question paper should contain sketches/diagrams/photographs/drawing s to overcome the problems of reading comprehension. Should be of short duration Type of question Each trainee has to perform minimum two NOS based skill test. Assessment has to be PC based in context of NOS. Type of question It will be correlated to soft skill related 13 NOS Performance will be evaluated upon the observation of 2 core domain related NOS practical Questions asked must be clear and have only one interpretation Question must be easy to use and require minimum time to answer As far as possible equal time should be given to all questions having same scores Questions having same time and same score should have same degree of difficulty All 2 NOS will be core domain based Practical question paper is to be printed and given to the candidate with performance checklist. Learning objective should match with PC based practical. *For Complete Details, refer to assessment Criteria template of EMT Constituents of quality assessment: 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. Accuracy of evidence – Validity Consistency of evidence – Reliability Adequacy of the suitable evidence to make accurate assessment – Sufficiency Evidence collected is recent and still relevant – currency Evidence collected and presented for assessment is of the candidate being assessed – Authenticity Assessment takes into account effects of variables to ensure accuracy – Flexibility Assessment tools , systems and procedures are consistent with equal opportunity principle Fairness Candidate is kept informed about the assessment criteria and is provided accurate and timely feedback – Transparency Assessment optimizes resources including time and material – Efficiency Improving to ensure all the above factors – Innovation Factors contributing to high quality assessment: Assessor aware of assessment strategy Assessment as per pre- defined assessment plan Assessment plan shared with all involved Assessment in a non-threatening environment Accurate and timely communication to all concerned Independent and competent assessor A rights and appeals procedure established and made known to candidates On – going internal assessment Adequate and appropriate documentation and records system Assessment Strategy – elements Occupational standards Competencies and competency criteria Selection of appropriate “Assessment Types” and methods for relevant competencies Quality assurance including internal and external assessors qualifications Internal assessments Record keeping External assessment Feedback Assessment Plan – Elements No. of candidates No. of Assessors NOS and PCs to be assessed Competencies to be assessed Time for assessment Communication to center/candidates Assessment methods Space required Equipment required Material required Competencies of an assessor for job role [Emergency Medical Technician / EMT] To carry out skill assessment of a candidate in a fair and just manner based on skill knowledge effectively evaluating the competence of the learner with respect to the occupational standards or learning objectives using the expertise possessed by the assessor. Competency is demonstrated ability applying knowledge, skill and attitude for the intended purpose of assessment. Competency assessed should be in accordance with the occupational standards, which identify and group, different tasks associated with a particular occupation and describe the degree of knowledge and level of skills that a worker must demonstrate to be considered competent in the occupation. Necessary academic & professional qualification and experience: Sl. No. 1. Job role Emergency Medical Technician [EMT] Qualification Medical graduate with a diploma in emergency medicine preferably with five years’ experience Competencies of an assessor Sound Domain knowledge & appropriate competency in the skill to be examined Knowledge of occupational standards for specific job role/ trade Able to meet the requirements of HSSC assessment guidelines Familiar with assessment scheme and through knowledge of relevant trade & skill Communication skills in the language of examination Be free from interest to conduct fair, impartial and non-discriminatory assessment Goal clarity and role clarity Ability to ask questions Listening and observation Able to conduct summative & formative assessment Problem solving and Working in a team Numeracy & Assertiveness Handling dysfunctional behavior Documentation and reporting Practical and problem solving Accountable Ability to go in detail Basic IT usage/Familiarity Presentation Desirable personal attributes of an assessor o o o o o o o o o Ethical Open minded Observant Perceptive Versatile Tenacious Decisive Self – reliant Communicative