RESEARCH EVALUATION BASED ON RMG SCORING RUBRICS (ACTION) MARYCEL A. PAGUIRIGAN Learning Facilitator Major Takeaways: Terminal Objective: At the end of the session, the participants are expected to demonstrate an understanding of the appraisal guides for proposed and completed action research. Major Takeaways: Enabling Objectives: Specifically, the participants shall: a. discuss the appraisal guides for proposed and completed action research as indicated in DEpEd Order 16, s. 2017 and harmonized guidelines in evaluating research in Region 2; b. apply understanding of the appraisal guides through evaluating one’s work; and c. appreciate the value of correctness and clarity in one’s research paper. Activity How do you evaluate your research work or others’ research work? Activity : What challenges did you encounter when you were writing in your research? Activity: How relevant is our understanding of the appraisal guides? GUIDE FOR APPRAISING ACTION RESEARCH PROPOSAL RATIONALE OF THE ACTION RESEARCH 30% CONTEXT & RATIONALE 15% PROPOSED INTERVENTION/INNOVATION/STRATEGY 15% ACTION RESEARCH QUESTIONS 30% ACTION RESEARCH METHODS 30% PARTICIPANTS AND/OR SOURCES OF DATA AND INFORMATION 10% DATA GATHERING METHODS 10% DATA ANALYSIS PLAN 10% WORKPLAN AND TIMELINES 5% COST ESTIMATES 5% TOTAL 100% CONTEXT & RATIONALE Not described 0 The action research proposal presents a general description of the problem of issue as its focus of inquiry. 8 The educational relevance and timeliness of the problem or issue are shown. The need to conduct action research as a way to address or improve the situation is explained. 12 The nature, extent and salience of the identified problem of issue are comprehensively discussed. Different aspects of the action research setting are elaborated showing in depth and critical analysis of the situation. 15 PROPOSED INTERVENTION, INNOVATION, STRATEGY Not presented 0 The action research proposal mentions an intervention, innovation or strategy to be tried out to address the problem or issue. 8 The proposal outlines when and where the intervention, innovation or strategy will be undertaken, and who will be involved. Activities to be undertaken are stated. 12 The rationale, extent and limitation of the intervention, innovation or strategy are explained in detail. Its plausibility as a way to address the problem or issue is given support. 15 ACTION RESEARCH QUESTIONS Not stated 0 The action research proposal has a stated aim, objective, or general research questions 15 The research question(s) specifies the action research variable(s) or the focus of inquiry. Key elements of the research question(s) are reflected in the title of the proposal. 25 The research question logically proceeds from the context of the inquiry. It clearly relates to the identified problem or issue, and conveys the desired change or improvement. 30 PARTICIPANTS AND/OR OTHER SOURCES OF DATA AND INFORMATION Not stated 0 The action research proposal states the target participants and/or other sources of data and information (ex: learners, teachers, documents, realia, learners’ products, others) 5 Details are provided about the target participants (ex: number, characteristics, sampling procedure if any) and/or other sources of data and information. Clear rationale for the inclusion of the study is given 10 DATA GATHERING METHODS Not described 0 The action research proposal presents a general description of the methods to be employed for gathering data 5 Details of data gathering methods are provided: the specific kinds of data, how and when they will be collected (ex: pretest and posttest scores). Research instruments, if any, are described (ex: test, scale, survey, questionnaire, checklist, interview guide, others) 8 The proposal explains why the selected data gathering method is suited to the nature and purpose of the action research. The data gathering method is aligned with the research questions. Research instruments, if any, are appropriate for obtaining desired kind of data/information. 10 DATA ANALYSIS PLAN Not stated 0 The action research proposal presents a general description of how the gathered data/information will be analyzed. 5 Details of the method of data analysis are given. Techniques (ex: quantitative/statistical, qualitative, or both methods), as well as tools (ex: software) to be employed are specified. 8 The selected method of data analysis is shown to be appropriate to the nature of the data/information to be gathered and for addressing the research questions 10 WORKPLAN AND TIMELINES Not included 0 The action research proposal includes a list of major activities and their timelines 3 A detailed work plan is provided covering start to completion of the research. Timeliness are realistic and show concretely how the research will unfold over the allowed period. The overall plan reflects the proponent’s capacity to concretize ideas into clear and sequential steps to be undertaken 5 COST ESTIMATES Not included 0 The action research proposal includes a list of major items and their estimated costs. The total costs is shown. 3 A detailed breakdown of items with their corresponding costs is furnished. The items and costs reasonably reflect the funding needs of the research and adhere to BERF guidelines. The overall plan reflects the proponent’s capacity to project specific expenses that she or he will be accountable for. 5 The passing rate for proposals is % GUIDE GUIDEFOR FORAPPRAISING APPRAISINGCOMPLETED COMPLETEDACTION ACTIONRESEARCH RESEARCH NOVELTY OF INTERVENTION NOVELTY OF INTERVENTION 20% 20% PROPOSED INTERVENTION/INNOVATION/STRATEGY ADOPTION OF RESEARCH INTERVENTION ACTION RESEARCH QUESTIONS PARTNERSHIP/EXTERNAL LINKAGES ACTION RESEARCH METHODS DISSEMINATION OF AND/OR RESEARCH FINDING PARTICIPANTS SOURCES OF DATA AND INFORMATION DATA CAPACITY TOGATHERING ADDRESSMETHODS MULTIPLE PROBLEMS DATA ANALYSIS PLAN WORKPLAN AND TIMELINES 15% 30% 15% 30% 15% 30% 25% 10% 10% 10% TOTAL COST ESTIMATES 10% 100% 5% 5% TOTAL 100% Scoring Guide for Appraising Action Research CRITERIA % Novelty of 20% Intervention MOV • Intervention material such as but not limited to Modules, SIM, etc. duly approved by authorities concerned • Rationale of the research, baseline data like diagnostic test, item analysis, NAT, etc. • Comprehensive description of how the intervention works • MOA, Endorsement letters from authorities, Certificates of Recognition from stakeholders (Internal/External) INDICATORS • The intervention concept - original • …timely in addressing problems in the TLP • Intervention/ innovation/ strategy is explained in details • Its plausibility to address issue is given support 20 points – all indicators are present 16 points- if any 3 indicators are present 12 points- if any two indicators are present 8 points - 1 indicator 0 point – if no indicator is met Scoring Guide for Appraising Action Research CRITERIA Adoption of Research Intervention % MOV 30% • Certificate of adoption duly signed by proper authorities • Narrative report from the adopter • Pictorials INDICATORS The intervention is adopted 30 points- adopted in the international/national level (at least 2 regions) 26 points- adopted in the regional level (at least 2 divisions) 22 points- adopted in the Division level (at least 2 districts) 18 points- adopted in the District level (at least 2 schools) 14 points- adopted in the school. Scoring Guide for Appraising Action Research CRITERIA Partnership/ External linkages % MOV 15% Certification from partners/ links (SUC’s, and private academic institutions, Civil Society Organizations, LGUs, Indigenous Cultural Communities, and other Development partners) INDICATORS The research has ensured mutual benefits and reinforced collaboration that arise from these partnerships 15 points- The research was implemented with at least 4 partners. 12 points- The research was implemented with three (3) partners. 9 points- The research was implemented with two (2) partners. 6 points- The research was implemented with one (1) partner. 0 point- Non partnership forged Scoring Guide for Appraising Action Research CRITERIA % Disseminat 25% ion of Research Finding MOV • Certificates of Recognition, Appreciation, Participation • Letter of invitation • Training Matrix, program • Photocopy (screenshot) of the journal/magazine bearing the researcher’s work • Copy of the research references INDICATORS The research was disseminated in Fora / Conferences / Colloquia / Symposia 25 points-disseminated or cited in International Forum/Conference or published in International refereed journals Printed or online materials / Journals 19 points-disseminated or cited in Regional Forum/Conference or published in Regional refereed journals (printed or online) The findings have been cited by other researchers 22 points-disseminated or cited in National Forum/Conference or published in National refereed journals (printed or online) 16 points-disseminated or cited in Division Forum/Conference or published in Division refereed journals (printed or online) 13 points-disseminated or cited in District/School Forum/Conference or published in District/School refereed journals Scoring Guide for Appraising Action Research CRITERIA % Capacity 10% to address multiple problems MOV Recommendations of the Study INDICATORS The research intervention/ innovation/strategy addresses multiple issues/problems/ concerns in the teaching-learning process other than the identified issues/problems/ concerns. 10 points-addresses at least 4 other issues/problems/concerns in the teaching-learning process. 8 points-addresses 3 other issues/problems/concerns in the teaching-learning process. 6 points-addresses 2 other issues/problems/concerns in the teaching-learning process. 4 points-addresses 1 issue/problem/concerns in the teaching-learning process. 2 points-applicable only to the identified issue/problem/concern in the teaching-learning process. Ponder on this: “Quality teaching is not an Act, it is a Habit” -Aristotle