Paediatric_HIV_AIDS_Training_M&E_System.

advertisement
THE RCQHC/ HCP/ACP PAEDIATRIC HIV/AIDS TRAINING
PROJECT
MONITORING AND EVALUATION SYSTEM
FOR
PAEDIATRIC HIV/AIDS TRAINING COMPONENT
DATE: JUNE 2011
LIST OF ABREVIATIONS
ACP
AIDS Control Program
AIDS
Acquired Immunodeficiency Syndrome
F
Female
GOV
Government
HC
Health Centre
HCP
Health Communication Partnership
HCW
Healthcare Worker
HIV
Human Immunodeficiency Virus
M
Male
M&E
Monitoring and Evaluation
MO
Medical Officer
MOH
Ministry of Health
NGO
Non-governmental Organization
RCQHC
Regional Centre for Quality of Health Care
TBD
To Be Discussed
TOT
Trainer of Trainers
ii
TABLE OF CONTENTS
LIST OF ABREVIATIONS ........................................................................................................ ii
TABLE OF CONTENTS ........................................................... Error! Bookmark not defined.
ACKNOWLEDGEMENT ...........................................................................................................v
1. INTRODUCTION ................................................................................................................. 1
1.2 Objectives ...................................................................................................................... 2
1.3 Approach to M&E ........................................................................................................... 2
1.3.1 Monitoring ................................................................................................................ 2
1.3.2 Evaluation ................................................................................................................ 3
2. M&E SYSTEM FRAMEWORK ............................................................................................ 4
2.1 Data Collection System .................................................................................................. 5
2.2 Data Processing, Analysis and Reporting ...................................................................... 5
2.3 Data Storage .................................................................................................................. 5
2.4 Evaluation and Feedback ............................................................................................... 5
2.5 Stakeholders .................................................................................................................. 6
3. DATA COLLECTION INSTRUMENTS ................................................................................ 7
3.1 Standard Attendance Form ............................................................................................ 7
3.2 Paediatric HIV/AIDS Training Report ............................................................................. 7
3.3 TOT Observation Tool and Observation Report ............................................................. 8
3.4 End Evaluation Participant Tool ..................................................................................... 8
BIBLIOGRAPHY ...................................................................................................................... 9
ANNEXES ............................................................................................................................. 10
1.0 SUMMARY PERFORMANCE INDICATORS ............................................................... 10
1.1 TRAINER OF TRAINERS ......................................................................................... 10
iii
1.2 FRONTLINE HEALTHCARE WORKERS ................................................................. 11
1.0 PERFORMANCE INDICATOR REFERENCE SHEET ................................................. 13
1.1 TRAINER OF TRAINERS ......................................................................................... 13
1.2 FRONTLINE HEALTHCARE WORKERS ................................................................. 19
2.0 TOOLS ......................................................................................................................... 25
2.1 STANDARDIZED PAEDIATRIC HIV/AIDS TRAINING ATTENDANCE FORM ......... 25
2.2 TOT OBSERVATION TOOL ..................................................................................... 26
2.3 PARTICIPANT DAILY EVALUATION FORM ............................................................ 27
2.4 PARTICIPANT END EVALUATION FORM ............................................................... 28
2.5 POST TRAINING SUPPORT SUPERVISION TOOL.......…..……………………..…..30
3.0 SUMMARY REPORTS ................................................................................................. 46
TRAINING REPORT ....................................................................................................... 47
TOT OBSERVATION REPORT ...................................................................................... 52
iv
ACKNOWLEDGEMENT
This document is a product of efforts by two consultant Medical Epidemiologists with training
in paediatrics; Ezekiel Mupere MBChB, M.Med (Paediatrics), PhD (Epidemiologist) and Eric
Wobudeya MBChB, M.Med (Paediatrics), MSc. (Epidemiology). The consultants were
facilitated by staff from three stakeholders: Regional Centre for Quality of Care (RCQHC),
AIDS Control Program (ACP), and Health Communication Partnership (HCP). We are
grateful to the consultants, all staff (Eva Magambo, Ruth Musekura, Kimberly Burns Case,
and Robert Nangai from HCP; Dr. Peter Elyanu from ACP; and Dr. Daniel Tumwine, Dr.
Henry Barigye, Dr. Micheal Mawanda, and Mr. Taasi Geoffrey from RCQHC), and
stakeholders who participated in a series of consultative meetings to conceptualize and
operationalize the framework, tools, indicators, and database.
This document was made possible by the support of the American people through the United
States Agency for International Development (USAID) and RCQHC. The views expressed by
the authors do not necessarily reflect those of these organizations.
v
1. INTRODUCTION
In Uganda it is estimated that 130,000 children under 14 years are living with HIV with 42,000
children in immediate need of life saving antiretroviral drug treatment. However, only 17,000
of these (41%) are receiving this essential intervention. Tackling the paediatric HIV/AIDS
pandemic is possible where resources are available, services are accessible, and efforts
coordinated.
The Regional Centre for Quality of Health Care (RCQHC) is affiliated to Makerere University
School of Public Health. RCQHC’s mission is to provide leadership in building regional
capacity to improve the quality of health care in Africa by promoting evidence-based better
practices.
The Regional Centre for Quality of Health Care (RCQHC) in partnership with the Health
Communication Partnership (HCP) is currently implementing a 2-year initiative to support the
MOH/AIDS Control Program (ACP) to scale up paediatric HIV services in Uganda. The
program aims to strengthen the capacity of healthcare providers in Uganda to offer quality
paediatric HIV/AIDS services (care, treatment and support). This RCQHC/HCP/ACP project
will train national and regional trainers for paediatric HIV/AIDS services and also offer them
support supervision as they train frontline healthcare providers.
The purpose of this Monitoring and Evaluation (M&E) system is to establish a unified and
coherent tracking of the trainings and supervision provided to the trainer of trainers (TOT),
and the trainings provided to the frontline health care workers (HCW). The data collected
through this framework will be used for tracking and reporting training outputs to the ACP at
the MOH and other stakeholders in a timely manner, monitoring and evaluating the
implementation of the project’s trainings, and feedback review to all stakeholders.
1
1.2 Objectives

Develop tools for collecting data on paediatric HIV/AIDS training and support
supervision done by this project.

Develop a system for collection of data on training and support supervision.

Develop a database for health care workers trained in paediatric HIV/AIDS care and
treatment and counselling.

Train project staff to maintain database and M&E system.

To improve reporting at all levels by making it simpler, better and faster.
1.3 Approach to M&E
In this M&E framework system, an approach based on results was adopted, which is derived
from four pillars:

Defined strategic goals which provide a focus for action

Specifications of expected outcomes which contribute to the achievement of the
desired goals

Alignment of processes, and resources in support of the expected outcomes

Ongoing monitoring and assessment of performance, integrating lessons learnt into
future planning; and improved accountability for results (whether this project made a
difference in the HCWs’ capacity to provide quality paediatric HIV/AIDS services in
Uganda).
The result-based monitoring system is based on the model of the linked hierarchy from inputs
to activities to outputs to outcome and ultimately impacts1.
1.3.1 Monitoring
Monitoring is a continuous function that uses the systematic collection of data on specified
indicators to provide management and the main stakeholders of an ongoing project with
indicators of the extent of progress and achievement of objectives and progress in the use of
allocated funds. It involves collecting, analyzing and reporting data on inputs, activities,
outcomes, impacts and external factors, in a way that supports effective management.
2
Monitoring usually reports on actual performance against what was planed or expected.
Monitoring in this training project will be conducted at two levels: activity and output.
Activity monitoring
Activities are the processes or actions that use a range of inputs to produce the desired
outputs and ultimately, outcomes. In essence, activities describe ‘what we do’. Activities will
be managed and monitored by the program staff at the MOH AIDS Control Program (ACP).
The program will maintain an activity database for tracking progress in terms of physical
implementation of the specified targets according to work plan. For monitoring purposes,
each activity plan specifies the output, activity description, activity schedule, inputs, progress
indicators and targets.
Output monitoring
Outputs are final products, goods and services produced for delivery. Outputs may be
defined as ‘what we produce or deliver’. They are the deliverables that the program budgets
for and produce following implementation of the planned activities. Tracking outputs data will
be obtained by aggregating results of from the activity database. Monitoring activities and
outputs data will be captured by using structured data collection instruments (Annex II).
1.3.2 Evaluation
Evaluation is the systematic and objective assessment of an ongoing or completed project
including its design, implementation, and results. It is a time-bound and periodic exercise that
seeks to provide credible and useful information to answer specific questions (lessons
learned) to guide decision making by project staff, managers, and policy makers. The aim is
to determine the relevance and fulfillment of objectives, development efficiency,
effectiveness, impact, and sustainability. Impact evaluations examine whether underlying
theories and assumptions were valid, what worked, what did not and why. Evaluation can
also be used to extract cross-cutting lessons from operating unit experiences and
determining the need for modifications to strategic results framework.
3
We carry out evaluations when it is deemed that the interventions so far implemented are
sufficient to have achieved a significant part of an objective. An objective is formulated as an
outcome (strategic objective) and a good proposed design for achieving an objective requires
specification of quantifiable results, a time frame, and a baseline for assessing change. In this
training project for trainers and frontline HCWs, an evaluation will use evidence from
quantitative results (knowledge) attained by participants during trainings; monitoring
supervision data for TOTs and quantitative pre-test results as baseline to determine whether
the targeted HCWs will have improved in knowledge to provide quality paediatric HIV/AIDS
services in Uganda.
2. M&E SYSTEM FRAMEWORK
An M&E System is the set of organizational structures, management processes, standards,
strategies, plans, indicators, information systems, reporting lines and accountability
relationships which enables departments, stakeholders, and other institutions to discharge
their M&E functions effectively. In this conceptual framework, we define the components of
the system, how the system functions, the key players, relationships between players and
assignment of responsibilities. The operational components in this M&E system (Figure 1) will
include:

Data collection system

Data processing, analysis, storage, and reporting

Evaluation for lesson learning

Partner organizations as key stakeholders
The necessary activities that will drive the implementation and attainment of the required data
will include: data collection system, processing, storage, analysis, reporting, and lesson
learning. The data will influence the project implementation, planning, and ensuring
sustainability of the training program to improve quality of paediatric HIV/AIDS services in
Uganda.
4
2.1 Data Collection System
Field lead trainers and supervisors at national, regional, and district levels will ensure that
training and supervision reports, and the supporting tools (Annex II and III) are completed
during field implementation. Designated lead trainers by the implementing organizations will
ensure that all training reports and supporting tools are delivered to the administrator at the
MOH ACP offices in both electronic and paper form in a timely manner. The ACP program
officer at the MOH will institute an administrative mechanism to ensure that implementing
organizations deliver timely the training reports and supporting tools to the ACP offices.
2.2 Data Processing, Analysis and Reporting
This designed M&E system will capture, integrate and store information from 1) all paediatric
HIV/AIDS trainings countrywide including national trainers, TOTs, and cascade training of
frontline HCWs and 2) support supervision sessions for TOTs. Data collected in this training
project through lead trainers of the training workshops and supervisions at national, regional
and district level will be submitted to the program officer and head of the database at the
MOH ACP offices. The program officer and his support staff will process the data. The team
at the ACP will conduct the in-house data quality assessment with a prepared report. The
ACP administrative team will enter the data into a prepared database, clean and conduct the
required analysis to prepare reports for stakeholders’ meetings and feedback.
2.3 Data Storage
The M&E data will be stored in hard and electronic formats. Designated M&E file for this
training project will be assigned and an electronic M&E database in excel spreadsheets has
been developed. The M&E data will be developed to capture data on all indicators at activity
and output levels (Annex I). The database will be maintained by the ACP team at the MOH
ACP offices.
2.4 Evaluation and Feedback
The ACP Program officer and the support staff will prepare evaluation and feedback reports
to stakeholders, affiliated support organizations and facilitators of the trainings. The feedback
will be conducted through regular quarterly and annual reports, reflection and learning
5
workshops, research dissemination workshops, publication of study findings, and direct
interaction with stakeholders and facilitators during implementation.
2.5 Stakeholders
The partner organizations in this training project include RCQHC, HCP, and ACP at the
MOH. The stakeholder organizations have provided support in development of training
reports and supporting tools for data collection. The stakeholders will receive formal
information and reports for the trainings from the program officer and the M&E team based at
the MOH ACP offices. The stakeholders will provide feedback and external quality assurance
regarding data collection, processing, and reporting to the program officer MOH ACP.
Figure 1: Operational M&E System Conceptual Framework
Data Collection system
Implementing
Organization
Lesson
and
Learning
Field Lead
Trainers
Sources of
Information
Electronic & Hard Copies:
 Training reports
 Supervision reports
MOH-ACP
Data:
Processing
Storage
Analysis
Reporting
Stakeholders:

HCP, ACP and
RCQHC
Role:
 External quality
assurance
 Feedback
 Reports to funders
6
3. DATA COLLECTION INSTRUMENTS
A set of tools has been developed for use in data collection by the RCQHC in consultation
with HCP and ACP – MOH as partners (Appendix II). The tools will be used to collect data on
paediatric HIV/AIDS trainings and support supervision for TOTs. The lead trainers for the
training workshops and supervision activities will send completed tools and the associated
supportive reports to the administrative staff at the ACP – MOH. The administrative staff and
ACP Program officer will process the data. The completed tools and supporting documents
will be filed in designed files as reference for audit at the ACP offices.
3.1 Standard Attendance Form
This form captures the number of participants for each training activity by their gender,
cadre of professional training, affiliated health facility, level of facility such as health
center III, facility district, e-mail and telephone contact. This form should be completed
for all training activities conducted by the MOH ACP. Each participant should complete
the form and sign. The lead trainer should sign and indicate the date when the activity
was implemented. The completed form should be used by the lead trainer to complete
the training report.
3.2 Paediatric HIV/AIDS Training Report
The training report should be completed immediately after the training by the lead
trainer using the Attendance Form. This report bears the unique identifier for the
training, date, details the background information concerning the training, the venue
and district location for the training, total number of participants by gender, course
name, course objectives, list of facilitators, course content, mode of delivery, course
assessment evaluation of participants for their pre- and post-test, summary of
participants’ course evaluation, challenges, recommendations, and list of participants
as detailed on the Attendance Form plus facility type, pre- and post-test for
participants.
This report should completed by the lead trainer immediately after the training. The
lead trainer is responsible and must e-mail the electronic and hard copies of this report
7
to the MOH ACP administration within a week after the training using the following email address: paedhivtrainings@gmail.com.
3.3 TOT Observation Tool and Observation Report
This form is used by the supervisor to observe and evaluate the TOT participant when
he/she facilitates a session. The supervisor will observe and rate the trainee TOT
through aspects of preparing, introducing, conducting, and transitioning between
topics. The trainee will also be observed and rated in feedback and conclusion of the
session to the participants. The trainee will be rated on four-likert scale from excellent,
to poor. The trainee will be expected to conduct several sessions and an aggregated
score will be obtained. Scores for at least three sessions will be aggregated onto the
Observation Report to judge the participant as one who can train independently, train
with minimal support, train after mentorship, or one who cannot train at all. The
Observation Report will also indicate the number of sessions the participant will have
conducted. The Observation Tool and the Observation Report should be completed,
signed, and dated when the training took place by the lead trainer. The completed tool
and report should be sent to the ACP Program Officer electronically and in hard copies
by the lead trainer.
3.4 End Evaluation Participant Tool
The End Evaluation Participant Tool should be completed by the participants on the
last day of the training after completion of the training the schedule. This tool captures
participants’ evaluation of the training content, input regarding facilitation and logistics,
process or schedule, procedures, and any further comments from participants
regarding sessions that were favorite, lacking in clarity or in information. The tool also
encourages participants to suggest ideas for improving the quality of the training. The
tool prompts the participant to rate various aspects of the training. The lead facilitator
should use the participants’ ratings to aggregate the participants’ course evaluation
score. The participants’ course evaluation score is captured in the training report.
8
3.5 Post Training Supervision Tool
The purpose of this tool is to determine the extent to which trained health workers
have translated the acquired knowledge, skills and attitudes into practice as frontline
pediatric HIV care service providers. This form is used by the support supervisor to
observe and evaluate the trained frontline health work when he/she is at work at
facility. The supervisor also uses this tool to evaluate how the trained health workers
have translated the acquired knowledge, skills and attitudes into practice at the facility.
The supervisor will use this to 1) make the follow-up on the implementation of the
three specific pledge actions that health workers made at the end of the training, 2)
assess the effectiveness of the referral system (intra-facility, Inter facility and
community-facility referrals), 3) determine the extent to which the facilities have
defined and provided a comprehensive care package (10 point management plan,
functional care team etc), 4) ensure proper use of the Health management information
systems; proper recording, utilization of data tools, completeness of data and
reporting; and 5) identify and address challenges related to paediatric HIV care and
treatment service provision at the facility. The supervision tool will be completed,
signed, and dated by the lead supervisor. The completed tool and report should be
sent to the ACP Program Officer electronically and in hard copies by the lead trainer.
BIBLIOGRAPHY
1. Based on “Results-Based Monitoring: Guidelines for Technical Cooperation Projects
and Programs”, GTZ, May 2004, p.9.
9
ANNEXES
1.0 SUMMARY PERFORMANCE INDICATORS
1.1 TRAINER OF TRAINERS
Performance Indicator
1.1 Number of TOT trained in
paediatric HIV Care and
Treatment
1.2 Proportion of TOT
supervised as they conducted
sessions in paediatric
HIV/AIDS Care & Trainings
1.3 Proportion of supervised
TOT in HIV Care and
Treatment who can train
independently or with minimal
support
1.4 Number of TOT trained in
HIV Counseling
1.5 Proportion of TOT
supervised as they conducted
sessions in paediatric HIV
Counseling
Definition and Unit of Measurement
Number of healthcare workers trained as
TOT in paediatric HIV Care and Treatment.
Unit: Number
Number of healthcare workers trained as
TOT in HIV Care and Treatment who were
supervised divided by the number that was
trained
Data source
Database
summary
report
Disaggregation
Cadre,
Region
Database
summary
report
Cadre
Unit: Percent
Number of supervised TOT in HIV Care and Database
Treatment who demonstrated the ability to summary
train independently or to train with minimal
report
support divided by the number that was
supervised
Unit: Percent
Number of personnel trained as TOT in HIV
Counseling.
Unit: Number
Number of personnel trained as TOTs in
HIV Counseling who were supervised
divided by the number that was trained.
National,
Regions,
gender
Target
Actual
Leader
ACP
ACP
TBD
ACP
Database
Summary
Report
Cadre
ACP
Database
Summary
Report
Cadre
ACP
Unit: Percent
10
Performance Indicator
1.6 Proportion of supervised
TOT in HIV Counseling who
can train independently or
with minimal support
Definition and Unit of Measurement
Number of supervised TOT in HIV
Counseling who demonstrated the ability to
train independently or to train with minimal
support divided by the number that was
supervised
Data source
Database
Summary
Report
Disaggregation
National,
Regions,
Gender
Target
TBD
Actual
Leader
ACP
Data source
Database
Summary
Report
Disaggregation
Cadre
Target
TBD
Actual
Leader
ACP
Database
Summary
Report
Cadre
TBD
ACP
Database
Summary
Report
Cadre
TBD
ACP
Unit: Percent
1.2 FRONTLINE HEALTHCARE WORKERS
Performance Indicator
2.1 Number of healthcare
workers trained in Paediatric
HIV/AIDS Care and
Treatment
2.2 Proportion of frontline
healthcare workers who
demonstrated improvement in
knowledge during the
Paediatric HIV/AIDS Care
and Treatment trainings
2.3 Proportion of frontline
healthcare workers
supervised as they conduct
Paediatric HIV/AIDS Care
and Treatment at facility
Definition and Unit of Measurement
Number of frontline healthcare workers
trained in Paediatric HIV/AIDS Care and
Treatment.
Unit: Number
Number of frontline healthcare workers who
attained a post-test score of 50% during the
Paediatric HIV/AIDS Care and Treatment
divided by the total number that was
trained.
Unit: Percent
Number of frontline healthcare workers who
were supervised as they conduct Paediatric
HIV/AIDS Care Treatment divided by the
total number that was trained.
Unit: Percent
11
2.4 Number of healthcare
workers trained in Paediatric
HIV/AIDS Counseling
2.5 Proportion of frontline
healthcare workers who
demonstrated improvement in
knowledge during the training
in HIV Counseling
2.6 Proportion of frontline
healthcare workers
supervised as they conduct
Paediatric HIV/AIDS
Counseling at facility
Number of frontline healthcare workers
trained in Paediatric HIV/AIDS Counseling.
Database
Summary
Report
Cadre
TBD
ACP
Unit: Number
Number of frontline healthcare workers who
attained a post-test score of 50% during the
training in HIV Counseling divided by the
total number that was trained.
Database
Summary
Report
Cadre
TBD
ACP
Unit: Percent
Number of frontline healthcare workers who
were supervised as they conduct Paediatric
HIV/AIDS Counseling at facility divided by
the total number that was trained.
Database
Summary
Report
Cadre
TBD
ACP
Unit: Percent
12
1.0 PERFORMANCE INDICATOR REFERENCE SHEET
1.1 TRAINER OF TRAINERS
Performance Indicator Reference Sheet
Level:
Trainer of Trainers
Indicator: 1.1 Number of TOT trained in paediatric HIV Care and Treatment.
Description
Definition: Number of healthcare workers trained as TOT in paediatric HIV Care and Treatment.
Unit of Measure: Number
Disaggregation by: Cadre, Region
Justification: The indicator measures the capacity to train healthcare workers in lowest health units in HIV Care and Treatment.
Overtime it indicates the number of newly trained TOT in HIV Care and Treatment; and over space it shows the coverage of TOT in HIV
Care and Treatment by region.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the TOT training report. TOT trainees will document their sex and
cadre on the attendance sheet. This information will later be transcribed onto the training report by the lead trainer.
Responsible Person: Field lead trainers and implementing organization at national and regional levels will ensure that training reports
are completed during field implementation and later delivered to the paediatric ACP Program Officer both electronically and hard copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received reports are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
13
Performance Indicator Reference Sheet
Level:
Trainer of Trainers
Indicator: 1.2 Proportion of TOT supervised as they conducted sessions in paediatric HIV/AIDS Care & Trainings.
Description
Definition: Percent of TOT healthcare workers supervised as they conducted paediatric HIV Care and Treatment.
Unit of Measure: Percent
Numerator: Number of TOT healthcare workers supervised as they conducted paediatric HIV Care and Treatment
Denominator: The number of TOT healthcare workers that was trained.
Disaggregation by: Cadre
Justification: This indicator is an assessment for quality of TOT in HIV Care and Treatment. Overtime it indicates the number of quality
assessments made among TOT in HIV Care and Treatment.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the observation tool report. The national trainers will supervise the
TOT. The lead observer will complete the observation report.
Responsible Person: Field lead observer and implementing organization will ensure that observation reports are completed during field
supervision of TOT. Electronic and hard copies of the observation report will be delivered to the ACP Program office by the lead observer.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received observation reports are complete and are received in
a timely manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
14
Performance Indicator Reference Sheet
Level:
Trainer of Trainers
Indicator: 1.3 Proportion of supervised TOT in HIV Care and Treatment who demonstrated the ability to train independently or with
minimal support.
Description
Definition: Percent of supervised TOT healthcare workers in HIV Care and Treatment who demonstrated the ability to train independently
or to train with minimal support.
Numerator: Number of supervised TOT healthcare workers in HIV Care and Treatment who demonstrated the ability to train
independently or to train with minimal support
Denominator: The number of TOT healthcare workers in HIV Care and Treatment who were supervised
Unit of Measure: Percent
Disaggregation by: Cadre, Region
Justification: The indicator measures both the available capacity and ability or quality of TOT to train healthcare workers in lowest health
units in HIV Care and Treatment. Prospectively it indicates the number of newly trained TOTs who have the ability to train in HIV Care and
Treatment. The coverage in the country can be shown according to regions.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the observation tool report. The national trainers will supervise the
TOT. The lead observer will complete the observation report.
Responsible Person: Field lead observer and implementing organization will ensure that observation reports are completed during field
supervision of TOT. Electronic and hard copies of the observation report will be delivered to the ACP Program office by the lead observer.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received observation reports are complete and are received in
a timely manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
15
Performance Indicator Reference Sheet
Level:
Trainer of Trainers
Indicator: 1.4 Number of TOT trained in HIV Counseling.
Description
Definition: Number of personnel trained as TOT in HIV Counseling.
Unit of Measure: Number
Disaggregation by: Cadre, Region
Justification: The indicator measures the capacity to train healthcare workers in lowest health units in HIV Counseling.
Overtime it
indicates the number of newly trained TOT in HIV Counseling; and over space it shows the coverage of TOT in HIV Counseling by region.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the TOT training report. TOT trainees will document their sex and
cadre on the attendance sheet. This information will later be transcribed onto the training report by the lead trainer.
Responsible Person: Field lead trainers and implementing organization at national and regional levels will ensure that training reports
are completed during field implementation and later delivered to the paediatric ACP Program Officer both electronically and hard copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received reports are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
16
Performance Indicator Reference Sheet
Level:
Trainer of Trainers
Indicator: 1.5 Proportion of TOT supervised as they conducted sessions in paediatric HIV Counseling.
Description
Definition: Percent of TOT personnel in HIV Counseling who were supervised as they conducted sessions in HIV counseling.
Unit of Measure: Percent
Numerator: Number of TOT personnel in HIV Counseling who were supervised
Denominator: The number of TOT personnel who were trained in HIV Counseling
Disaggregation by: Cadre
Justification: This indicator is an assessment for quality of TOT in HIV Counseling. Overtime it indicates the number of quality
assessments made among TOT in HIV Counseling.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the observation tool report. The national trainers will supervise the
TOT. The lead observer will complete the observation report.
Responsible Person: Field lead observer and implementing organization will ensure that observation reports are completed during field
supervision of TOT. Electronic and hard copies of the observation report will be delivered to the ACP Program office by the lead observer.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received observation reports are complete and are received in
a timely manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
17
Performance Indicator Reference Sheet
Level:
Trainer of Trainers
Indicator: 1.6 Proportion of supervised TOT in HIV Counseling who demonstrated the ability to train independently or with minimal
support.
Description
Definition: Percent of supervised TOT in HIV Counseling who demonstrated the ability to train independently or to train with minimal
support.
Numerator: Number of supervised TOT in HIV Counseling who demonstrated the ability to train independently or to train with minimal
support
Denominator: The number of TOT personnel in HIV Counseling who were supervised
Unit of Measure: Percent
Disaggregation by: Cadre, Region
Justification: The indicator measures both the available capacity and ability or quality of TOT to train healthcare workers in lowest health
units in HIV Counseling. Prospectively it indicates the number of newly trained TOTs who have the ability to train in HIV Counseling. The
coverage in the country can be shown according to regions.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the observation tool report. The national trainers will supervise the
TOT. The lead observer will complete the observation report.
Responsible Person: Field lead observer and implementing organization will ensure that observation reports are completed during field
supervision of TOT. Electronic and hard copies of the observation report will be delivered to the ACP Program office by the lead observer.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received observation reports are complete and are received in
a timely manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
18
1.2 FRONTLINE HEALTHCARE WORKERS
Performance Indicator Reference Sheet
Level:
Frontline Healthcare Workers
Indicator: 2.1 Number of healthcare workers trained in Paediatric HIV/AIDS Care and Treatment.
Description
Definition: Number of frontline healthcare workers trained in Paediatric HIV/AIDS Care and Treatment.
Unit of Measure: Number
Disaggregation by: Cadre
Justification: The indicator measures the capacity of healthcare workers to promote and provide Paediatric HIV/AIDS Care and
Treatment. This indicator overtime shows the number of newly trained healthcare workers in Paediatric HIV/AIDS Care and Treatment
and thus an increase in capacity to promote and provide Paediatric HIV/AIDS Care and Treatment. The distribution can be shown by
cadre.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the training report for frontline healthcare workers. Participants during
the cascade training will document their sex and cadre on the attendance sheet. This information will later be transcribed onto the training
report by the lead facilitator.
Responsible Person: Field lead facilitator and the implementing organization will ensure that training reports are completed during field
implementation and later delivered to the paediatric ACP Program Officer both electronically and in hard copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received reports are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
19
Performance Indicator Reference Sheet
Level:
Frontline Healthcare Workers
Indicator: 2.2 Proportion of frontline healthcare workers who demonstrated improvement in knowledge during the Paediatric HIV/AIDS
Care and Treatment trainings.
Description
Definition: Proportion of frontline healthcare workers who attained a score of 50% in post-test during the Paediatric HIV/AIDS Care and
Treatment.
Unit of Measure: Percent
Numerator: Number of frontline healthcare workers who attained a score of 50% in post-test during the Paediatric HIV/AIDS Care and
Treatment
Denominator: The total number of frontline healthcare workers that was trained
Disaggregation by: Cadre
Justification: The indicator measures the capacity of healthcare workers to promote and provide Paediatric HIV/AIDS Care and
Treatment. This indicator overtime shows the number of newly trained healthcare workers in Paediatric HIV/AIDS Care and Treatment
and thus an increase in capacity to promote and provide Paediatric HIV/AIDS Care and Treatment. The distribution can be shown by
cadre.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the training report for frontline healthcare workers. Participants during
the cascade training will document their sex and cadre on the attendance sheet. This information will later be transcribed onto the training
report by the lead facilitator.
Responsible Person: Field lead facilitator and the implementing organization will ensure that training reports are completed during field
implementation and later delivered to the paediatric ACP Program Officer both electronically and in hard copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received reports are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
20
Performance Indicator Reference Sheet
Level:
Frontline Healthcare Workers
Indicator: 2.3 Proportion of frontline healthcare workers who were supervised as they conduct the Paediatric HIV/AIDS Care and
Treatment at facility.
Description
Definition: Proportion of frontline healthcare workers who were supervised as they conduct the Paediatric HIV/AIDS Care and Treatment
at facility.
Unit of Measure: Percent
Numerator: Number of frontline healthcare workers who were supervised at the facility as they conduct Paediatric HIV/AIDS Counseling
Denominator: The total number of frontline healthcare workers who were trained
Disaggregation by: Cadre
Justification: The indicator measures the extent to which trained healthcare workers have acquired knowledge, skills and attitudes into
practice as service providers. This indicator overtime shows the numbers of trained healthcare workers supervised at facility level and are
in practice. The distribution can be shown by cadre.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the post-training supervision tool for frontline healthcare workers. The
post-training supervision leader will complete the tool with names of healthcare workers supervised and their respective district and
facility. This information will later be entered into the database for frontline healthcare workers by the ACP administrator.
Responsible Person: Field lead post-training supervisor and the implementing organization will ensure that post-training supervision
tools are completed during field implementation and later delivered to the paediatric ACP Program Officer both electronically and in hard
copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of the post-training supervision tools
Responsible Person: The paediatric ACP Program Officer will ensure that received tool are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
21
Performance Indicator Reference Sheet
Level:
Frontline Healthcare Workers
Indicator: 2.4 Number of healthcare workers trained in Paediatric HIV/AIDS Counseling.
Description
Definition: Number of frontline healthcare workers trained in Paediatric HIV/AIDS Counseling.
Unit of Measure: Number
Disaggregation by: Cadre
Justification: The indicator measures the capacity of healthcare workers to promote and provide Paediatric HIV/AIDS Counseling. This
indicator overtime shows the number of newly trained healthcare workers in Paediatric HIV/AIDS Counseling and thus an increase in
capacity to promote and provide Paediatric HIV/AIDS Counseling. The distribution can be shown by cadre.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the training report for frontline healthcare workers. Participants during
the cascade training will document their sex and cadre on the attendance sheet. This information will later be transcribed onto the training
report by the lead facilitator.
Responsible Person: Field lead facilitator and the implementing organization will ensure that training reports are completed during field
implementation and later delivered to the paediatric ACP Program Officer both electronically and in hard copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received reports are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
22
Performance Indicator Reference Sheet
Level:
Frontline Healthcare Workers
Indicator: 2.5 Proportion of frontline healthcare workers who demonstrated improvement in knowledge during the training in HIV
Counseling.
Description
Definition: Proportion of frontline healthcare workers who attained a score of 50% in post-test during the Paediatric HIV Counseling
training.
Unit of Measure: Percent
Numerator: Number of frontline healthcare workers who attained a score of 50% during the Paediatric HIV Counseling training
Denominator: The total number of frontline healthcare workers who were trained
Disaggregation by: Cadre
Justification: The indicator measures the capacity of healthcare workers to promote and provide Paediatric HIV Counseling. This
indicator overtime shows the number of newly trained healthcare workers in Paediatric HIV Counseling and thus an increase in capacity to
promote and provide Paediatric HIV Counseling. The distribution can be shown by cadre.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the training report for frontline healthcare workers. Participants during
the cascade training will document their sex and cadre on the attendance sheet. This information will later be transcribed onto the training
report by the lead facilitator.
Responsible Person: Field lead facilitator and the implementing organization will ensure that training reports are completed during field
implementatin and later delivered to the paediatric ACP Program Officer both electronically and in hard copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of training reports
Responsible Person: The paediatric ACP Program Officer will ensure that received reports are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
23
Performance Indicator Reference Sheet
Level:
Frontline Healthcare Workers
Indicator: 2.6 Proportion of frontline healthcare workers who were supervised as they conduct the Paediatric HIV/AIDS Counseling at
facility.
Description
Definition: Proportion of frontline healthcare workers who were supervised as they conduct the Paediatric HIV/AIDS Counseling at
facility.
Unit of Measure: Percent
Numerator: Number of frontline healthcare workers who were supervised at the facility as they conduct Paediatric HIV/AIDS Counseling
Denominator: The total number of frontline healthcare workers who were trained
Disaggregation by: Cadre
Justification: The indicator measures the extent to which trained healthcare workers have acquired knowledge, skills and attitudes into
practice as service providers. This indicator overtime shows the numbers of trained healthcare workers supervised at facility level and are
in practice. The distribution can be shown by cadre.
Plan for Data Acquisition
Data Collection Method: Data for this indicator will be captured by the post-training supervision tool for frontline healthcare workers. The
post-training supervision leader will complete the tool with names of healthcare workers supervised and their respective district and
facility. This information will later be entered into the database for frontline healthcare workers by the ACP administrator.
Responsible Person: Field lead post-training supervisor and the implementing organization will ensure that post-training supervision
tools are completed during field implementation and later delivered to the paediatric ACP Program Officer both electronically and in hard
copy.
Data Quality Issues
Actions: Completeness and timeliness in delivery of the post-training supervision tools
Responsible Person: The paediatric ACP Program Officer will ensure that received tool are complete and are received in a timely
manner.
Plan for Data Analysis, Review, and Reporting
Data Entry: Data will be entered and cleaned in the MS Excel spreadsheet by the administrative assistant at the ACP Program Office.
Data Analysis: Counts using the MS Excel Spreadsheet Report
Presentation: Frequency tables and Bar graphs
Review of Data: Annual
Reporting: The results will be reported in the HIV/AIDS MOH ACP annual program report.
24
2.0 TOOLS
2.1 STANDARDIZED PAEDIATRIC HIV/AIDS TRAINING ATTENDANCE FORM
Name of Training:________________________________________________________________________________________________
Date of Training: _____/______/___________
Training Venue:________________________________________________________
Serial
No.
Names
(Surname first, given name)
Sex:
(M/F)
Cadre
(e.g
MO)
Health Facility
Name
Facility
Level e.g
HC III
Facility
District
E-mail
Telephone
Signature
25
2.2 TOT OBSERVATION TOOL
Date:___/____/_____ Course
Name:__________________________________________________
(Day/Mon/Year)
Supervisee
Name:______________________________________________________________________
Module:_______________________________ Session:______________________________
Training Venue:_________________________ District :___________________________
Rating Scale: 3=Excellent 2=Good 1=Needs Improvement 0=Poor
Item
Rating
Comments
Preparation:
Trainer prepared for the session ahead of time
3 2 1 0
Introduction:
Trainer explained purpose and objectives of the activity
(why it is important to the learners, what they will
3 2 1 0
practice, etc.)
Conducting Practical Exercises/ Group activities:
Explained tasks clearly and involved learners
Organized and supported learners to complete their
3 2 1 0
tasks
Activity was reviewed well
Conducting Games:
Explained tasks clearly
3 2 1 0
Organized learners and Facilitated games
Conducting Interactive Activities:
Used a variety of activities and approaches in order to
keep participants’ engaged
3 2 1 0
Used (or followed) the training materials (e.g. used
slides, key messages from Facilitator’s Guide and
referred participants to their guides as needed, etc.)
Adapted activities to participants’ needs
Asked open-ended questions
Time keeping
Transitioning: Trainer provided smooth transitions
between topics, explicitly indicating a shift in topic and
3 2 1 0
linking topics together.
Feedback: Listened to participants and open to
3 2 1 0
feedback
Concluding: Trainer summarized activity, emphasized
key points & related topic to learners’ experiences &/or
3 2 1 0
rest of training course.
Objectives: How well were the objectives of this
session met?
3 2 1 0
Overall evaluation of the session, add all ratings out of
27
26
2.3 PARTICIPANT DAILY EVALUATION FORM
Date:____/____/_______ Course
Name:______________________________________________
(Day/Mon/Year)
Venue:_______________________________
District _________________________
Please take a momentary to complete this form to give us a quick feedback on the positive and
negative aspects of this training that happened today. Do not put your name.
List the strengths and weakness of today’s training
Strengths
Weaknesses
1.
1.
2.
2.
3.
3.
List the key issues that you learnt from today’s sessions
Name the Concepts that were difficult to understand from today’s sessions
Suggestions for improvement
27
2.4 PARTICIPANT END EVALUATION FORM
Date:____/____/_______ Course
Name:______________________________________________
(Day/Mon/Year)
Venue:_______________________________
District _________________________
Evaluation Information
Please take a moment to rate (from zero as worst to 10 as best) this Training in terms of
Content, Facilitation, Time Management, and Responsiveness to your educational needs. Also
provide Comments accordingly. (Your comments are an important contribution to our designing
training/learning experiences that meet your professional needs).
Please circle one choice for each statement
Training Content:
I feel that the content provided valuable information, skills and experiences relevant to the topic.
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
I can easily apply the training’s subject matter to my job/work.
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
I understood the training content:
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
Training Input: Facilitation and Logistics
I feel can easily use the training materials that I received as part of the training.
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
The training materials were enough.
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
The training venue was appropriate:
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
The meals at the training venue were excellent:
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
28
Training Process: Schedule
The opportunity for interacting, participating and asking questions was excellent:
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
The instructor’s knowledge and facilitation style was excellent:
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
The number of days allocated to this training was adequate.
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
The home work given was helpful.
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
Training Product
Overall the value of the training program was excellent:
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
I would recommend this training to colleagues in my area of work/practise.
0_____1_____2_____3_____4_____5_____6_____7_____8_____9_____10
Strongly disagree
Strongly agree
Further Comments:
What was your favourite session in this training?
What aspects of training do you want more information on?
What session do you feel should be modified?
What should we do to improve the quality of this training?
Please provide any additional comments which you feel would be useful to enhance this
training, to develop new training programs, or to provide to individual speakers.
For Official Use Only: Total Evaluation Score Out of 130 ________________ (Add all the
ratings)
29
2.5 POST TRAINING SUPPORT SUPERVISION TOOL
MINISTRY OF HEALTH – UGANDA
District:__________________________________________
Facility:__________________________________________
Facility Level:_____________________________________
IP:______________________________________________
Date visited:_______________________________________
30
Background
In Uganda it is estimated that roughly 146,000 children under 14 years are living with HIV/AIDS.
Roughly 76,750 of these are in immediate need of ARV treatment and yet only 24% (18,500)
have access to ART. However, without ART, 50% of HIV-positive children will die before
reaching the age of three years and an additional 25% will die by age five. Most of these deaths
can be prevented if children born to HIV-infected mothers are diagnosed early, receive proper
health care and nutrition and are initiated on HIV treatment as soon as they are eligible.
In Uganda paediatric ART services remain low with 68% and 58% of General Hospitals and HC
IVs respectively providing any form of Paediatric ART provision, compared with 100% and 82%
respectively providing adult ART services. This presents a major barrier to testing at-risk
children and enrolling HIV-positive children in ART programmes. In addition, most health care
workers lack the skills to identify, treat and care for children at risk of HIV and to counsel and
provide psycho-social support for HIV-positive children and their caregivers. A number of
partners are involved in training paediatric ART service providers and providing paediatric
HIV/AIDS services, but guidelines and curricula to support these activities have not been
harmonised.
The Regional Centre for Quality of Health Care (RCQHC) in partnership with the Health
Communications Partnership (HCP) are currently implementing a 2-year initiative to support the
MOH/AIDS Control Programme (ACP) to scale up paediatric HIV services in Uganda by
strengthening the capacity of health care providers at hospitals and health centres in Uganda to
refer children at risk of HIV for testing and HIV/AIDs services; to counsel caregivers and children
affected by HIV/AIDS; and to offer quality HIV/AIDS counseling, care, support and treatment
services for children with HIV/AIDS. This will be achieved through training of health care
providers, training of trainers from districts and partner organizations, and mentoring /support
supervision of health care providers.
31
Training of health professionals
A standardised Paediatric HIV Care and Treatment training curriculum was developed and mid
level health workers have been trained with the aim of greatly improving their capacity to
manage paediatric HIV/AIDS patients The five day practical in-service training is a part of the
package of trainings for health care professionals requires mentor team follow up-visits to offer
individualized support and follow up.
Goal of the support supervision:
The goal of the support supervision is to determine the extent to which trained health workers
have translated the acquired knowledge, skills and attitudes into practice as frontline pediatric
HIV care service providers.
Specific objectives
The support supervision exercise will specifically achieve the following objectives
1. Follow up on the implementation of the three specific pledge actions that health workers
made at the end of the training
2. Assess the effectiveness of the referral system (intra-facility, Inter facility and
community-facility referrals)
3. Determine the extent to which the facilities have defined and provided a comprehensive
care package (10 point management plan, functional care team etc)
4. Ensure proper use of the Health management information systems; proper recording,
utilization of data tools, completeness of data and reporting.
5. Identify and address challenges related to paediatric HIV care and treatment service
provision at the facility
32
TIME TABLE FOR POST TRAINING SUPPORT SUPERVISION VISIT
Day 1
8:30-9:00 am
9:00-9:30 am
9:30-10:00 am
10:00-10:30 am
10:30-1:00pm
1:00-2:00pm
2:00-3:30 pm
Day 2
Team
Team member 1
member 2
Meeting with DHO
Meeting with facility In charge
Meeting with Trainees
Break Tea
Observe case
Chart Review
management and
improve skills
Lunch
Checking Availability of
Paed Formulations and
test kits
Client
satisfaction
review
3:30-4:00 pm
Team meets to prepare feed back
4:00-5:00 pm
Debrief meeting
8:30-9:00 am
9:00-9:30 am
9:30-10:00 am
10:00-10:30 am
10:30-12:00
Team member 1
Team member 2
Work with Site to implement some of the
action point discussed in the debrief
12:00-1:00pm
Development of key follow up actions
with Team
Debrief to Health facility in charge
1:00-2:00pm
2:00-3:00 pm
Lunch
Debrief to DHO
3:00-5:00 pm
Travel to the Next district
33
1. PREPARATION FOR POST TRAINING FOLLOW UP VISIT (to be filled before leaving for the field)
Check list for preparation:
Item
Yes
No
Comment
Has district been communicated to about Visit?
Has health facility been communicated to about Visit?
Is the list of trainees available?
Are pledge of action cards available for each site?
Have sufficient forms for the Visit been printed?
Names of Trainees being followed
Names
1
Cadre
Tel contact
Was trainee available to be follow up on site
Yes
No
2
3
4
5
34
2. INTRODUCE THE FOLLOW-UP ACTIVITY

Make a brief stopover at DHO’s office: Introduce yourself and explain purpose of Visit

Introduce your self to the Health facility in charge, explain the purpose of the visit, and identify the health worker(s) you would like
to observe.
3. MEET BRIEFLY WITH RELEVANT STAFF. (Review the pledge of action cards)

Explain what you will do.

Ask staff what they are doing differently or have seen since the training.

Become oriented to the facility: See the examination and treatment areas and areas where patient records and drug supplies are
kept.

Identify a place to observe case management practices and give feedback.
Pledge of action
Action taken
Comments
( yes or No)
1
2
35
Indicate any other actions or changes the team has instituted since after training
Availability of Job Aides.
Job Aide
Is it available?
Are
they Are the Job aides Placed in the
being Used?
right Place? If in a wrong place,
help the worker place it in the
right place. If nonexistent, leave
behind the new guidelines.
Yes
No
Yes
No
Yes
No
HIV testing algorithm
National Paediatric ART guidelines 2011
Paediatric ART dosing by formulation and wt range Feb. 2011
Paediatric ART dosing Pamphlet Feb 2011
WHO Paediatric ART clinical staging
Atlas of common opportunistic infections in children
36
4. OBSERVE CASE MANAGEMENT AND REINFORCE SKILLS (should be done with patients with a range of
problems)

Select some children in the waiting area, introduce yourself, explain what you intend to do and ask permission. Choose different
types of patients. For chronic HIV care patients, include Pre-ART and ART, quick and regular circuit patients by quickly asking
them the reason why they are there.

Follow the patient through the entire sequence of care. Follow through and record steps the patient goes through and observe
the process. Privately, help the health worker identify problems in case management and solve them. Note problems with patient
flow/team work/task shifting and save them for the clinical team meeting.
Area
Aspects to be observed
Response
Yes
Triage
Is
there
Triage
Comment
No
Area?
( if no establish one with staff)
Is Triage being done? (reception, wt taken,
BP, Temp, retrieval of charts)
Are Patients are triaged into regular and
quick circuits
[Help train team member in triage.]
Immunization
Is immunization status of children under 5
being reviewed
Growth
monitoring
Are Weights taken for all children’s
Are weight’s being interpreted.
37
Area
Aspects to be observed
Response
Yes
Development
monitoring
Does the clinician review the developmental
Clinical
assessment,
Clinical
Staging, CD
monitoring and
OI prophylaxis.
Are clinical assessments done for possible
Comment
No
milestones of the children?
opportunistic infections?
Are patients assessed for TB?
Is TB status recorded on the Charts?
Do clinicians do WHO clinical staging
correctly?
( Support clinician to use WHO Paediatric
HIV clinical staging charts)
Do clinicians stage children at every visit? (
Emphasize the need to conduct staging at
every visit and its importance for monitoring
either progress in treatment or eligibility for
ART)
Is WHO stage documented at each visit?
Are
CD4’s
(Check
requested
whether
clinician
for
children?
knows
the
38
Area
Aspects to be observed
Response
Yes
Comment
No
frequency for doing CD4’s)
Are they recorded in Patient chart?
Can the clinician identify eligible patients
using WHO and CD4 clinical staging
criteria?
( Review criteria for initiation of ART in
children)
Are
all
children
given
cotrimoxazole
prophylaxis?
Are
the
doses
correct?
( Check for use of the Dosing charts if not
being used support the clinicians to use
these)
Psychosocial
ART readiness counseling and evaluation
and adherence for ART eligible patients done?
Is adherence counseling and assessment
support
done at every visit?
Are pill counts done? (Review how to
calculate adherence based on pill counts).
Is
all
the
psychosocial
information
documented on the charts?
39
5. CHART REVIEW FOR COMPLETENESS AND ART INITIATION
From the Pre ART register select 5 children (under 2 years of age) enrolled into care in the past 3-4 months. Retrieve these Patients
charts and do this review per chart. If the children under 2yrs are not five in number, pick other children above 2 years.
Use one column per chart
Patient 1
Patient 2
Patient 3
Patient 4
Patient 5
ASSESSMENT FOR ART ELIGIBILITY AND Tick box if the parameter was recorded in the ART card. Total number of ticks
INITIATION OF ART
Mark 0 if it was not done. Draw a line through the boxes that of number interviewed
are not applicable to the case. Use codes: 1-yes and 2-No.
on the subject
Was Weight taken?
Is MUAC done?
Was TB status filled?
Are any OI’s recorded?
Was functional status recorded?
Is WHO clinical stage done?
Was cotrimoxazole prescribed?
Was dose correct?
Was CD4 done?
40
Has this patient identified as eligible for
ART?
Was adherence counseling done?
How many adherence counseling visits has
the child had?
Was patient given weekly appointments for
adherence
counseling
(Longer
appointment
durations
for
adherence counseling often delays initiation
of ART)
Is the child Initiated on ART?
What is the ARV regimen? Is it the
recommended 1st line regimen
If patient was initiated on NVP based
regimen, was leading In done?
Are the ARV doses correct?
(
review use of dosing charts and check if
dispensing team as well has dosing chart)
If patient has had subsequent visits after
initiation
of
ART, Was
adherence
assessed?
41
6. CONDUCT EXIT INTERVIEWS (this will apply if your visit was on a clinic day where patients are available)

Select 5 caretakers of HIV positive children (0-14 yrs) leaving the facility and introduce yourself.

Interview patients/caretakers and record notes on the Exit Interview Form below
Use one column per interview
Patient
1
CARETAKER/PATIENT KNOWLEDGE
Patient
2
Patient
3
Patient
4
Patient 5
Tick box if patient has correct knowledge of all items mentioned. Total number of
Mark 0 if patient does not know all. Draw a line through the ticks of number
boxes that are not applicable to the case
interviewed on the
subject
Patient/caretaker given co-trimoxazole:
knows how many tablets to give child
per day; why is it important for the
child?
Patient/caretaker given ART: knows
correct number of tablets to give child;
times per day
Patient/caretaker given another drug:
knows how many tablets to take; times
per day
Patient/caretaker knows when next
follow-up appointment is
42
PATIENT/CARETAKER SATISFACTION
Score on scale of (indicate the score per patient interviewed)
0
1
2
3
4
5
6
7
Poor
Patient1
8
9
10
Indicate the total
score for each
row.
Excellent
Patient2
Patient3
Patient 4
Patient 5
Time health worker spent with me
Way health worker examined child
Treatment given child
Way health worker talked with me
What I learned from health worker
43
7. REVIEW OF DATA
From the Pre ART and ART Register, Please indicate the numbers of children enrolled into care and on ART for the months of Dec
2010 to May 2011. Please mark the month when training was done.
Dec
Jan
Feb
March
April
May
Pre ART
ART
8.

GUIDE FOR DEBRIEFING MEETING (Facilitate problem solving with the staff)
Congratulate the staff on progress they have made in implementing paediatric HIV care and explain that the purpose of meeting
is to solve problems they face.

Ask the staff what problems they have found in starting to provide paediatric HIV care and treatment. Listen as they discuss
each problem, summarize what you hear; and add any other problems that you have identified.

For each problem, ask about possible solutions. Listen; summarize decisions made; add and discuss any other practical
solutions from the Checklist of Facility Supports.

Remember: Give each staff member time to think

Ask questions to support good solutions

Make notes on your checklist

Support, do not undermine, the trained health worker

With the staff, identify problems to communicate to the district or national level to request assistance.

Review with the staff evidence of their progress implementing Paediatric HIV care and Treatment. Thank the staff.

Provide any Tools or Job aides
44
9. WRITE SUMMARY REPORT OF THE VISIT
Leave copy of the report with facility and district
Strength
Areas of
Action taken
Pending Action
By who?
Improvement
45
3.0 SUMMARY REPORTS
46
MINISTRY OF HEALTH – UGANDA
PAEDIATRIC HIV/AIDS
TRAINING REPORT
Prepared By:
______________________________________________________
Name
Signature
Date
For Official Use Only: Training Report ID No.__________
47
INSTRUCTIONS
Please fill in all the parts on this report. Most of the participant information is on the Attendance
Form. The only information that is not on the Attendance Form that you need to include is
Facility Type (government, NGO, etc.), and Pre and Post Training Test scores. While the
training is taking place, it is good to check that you know all the Facility Types.
The report for this training should be completed IMMEDIATELY after the training.
The team leader is responsible and must e-mail the electronic copy and hard copies of this report
to the Ministry of Health AIDS Control Program Administration within a week after the training using
the following e-mail address: paedhivtrainings@gmail.com.
1.0 INTRODUCTION
1.1 Background Information:
(Please provide brief background information about this training.)
1.2 Overview:
Training Venue: _____________________ District of Training: ____________________
Organized By: _______________________ Funded By: __________________________
Total Number of Trainees: __________
Males: _________
Females: __________
Course Name: (Please check one box: (Double click the box, under default value click on
“checked”.)
1=Early Infant Diagnosis
5=Prevention of Mother-to-Child Transmission
2=Paediatric HIV/AIDS Counseling
6=Integrated Management of Adulthood
Illnesses
3=Paediatric HIV Care & Treatment
7=Integrated Management of Childhood
Illnesses
4=Trainer of Trainers (Specify) ________
8=Other
(Specify):__________________________
Actual Number of Training Days: __________ (Days)
Start Date: ____/____/____
(Day/Mon/Year)
End Date: ____/____/____
(Day/Mon/Year)
48
2.0 OBJECTIVES OF COURSE
(Please provide specific objectives about this training.)
3.0 FACILITATION AND COURSE CONTENT
3.1 Trainers (Indicate names, cadre, and affiliated facility or organization):
1.
2.
3.
4.
5.
3.2 Course Content (Summarize Modules):
3.3 Methods of Delivery:
4.0 COURSE ASSESSMENT AND EVALUATION
4.1 Participant Assessment:
Pre Test
Post Test
Average Class Score
Best Mark
Worst Mark
Number Passed with ≥50%
Number Failed with <50%
49
4.2 Evaluation: (Summarize participants’ evaluation of the course participants)
Training Item
Score
Training Content out of 30
Training Input out of 40
Training Process put of 40
Training Product out of 20
Total Evaluation Score out of 130
Summarize participants’ comments on the following headings:
1. Favourite session(s) in this training
2. Aspects of the training to which participants needed more information
3. Session(s) that participants felt need modification
4. Participants’ suggestion(s) to improve the quality of this training
5. Additional comments participants felt would be useful to enhance this training, to
develop new training programs, or to provide feedback to individual speakers.
4.3 Challenges:
4.4 Recommendations:
50
List of Participants
Serial
Surname
Given Name
Sex:
(M/F)
Cadre
(e.g
MO)
Facility Name
Facility
Level (e.g
HC IV)
Facility
Type (e.g
Gov)
Facility
District
PreTest
Post
Test
E-mail
Telephone
51
TOT OBSERVATION REPORT
Date:____/____/_______
Course
Name:___________________________________________
(Day/Mon/Year)
Supervisee Name:___________________ Number of Sessions Observed: __________
Training Venue:_____________________ District:_______________________________
Organized By:______________________ Funded By:____________________________
Rating Scale:
3=Excellent
2=Good
1=Developing
0=Poor
Serial Question
No.
1
How well did the trainer prepare for
the session ahead of time?
Sessions
Comments
1_______ 2_______ 3_______
3 2 1 0 3 2 1 0 3 2 1 0
2
How well did the trainer introduce the
session?
3
2 1 0 3
2 1 0 3
2 1 0
3
How well did the trainer conduct
practical exercises or group activities?
3
2 1 0 3
2 1 0 3
2 1 0
4
How well did the trainer conduct
games and interactive activities?
3
2 1 0 3
2 1 0 3
2 1 0
5
How well did the trainer conduct
interactive activities?
How well did the trainer provide
smooth transitions?
How well was feedback received from
the participants?
3
2 1 0 3
2 1 0 3
2 1 0
3
2 1 0 3
2 1 0 3
2 1 0
3
2 1 0 3
2 1 0 3
2 1 0
How well did the trainer close the
session emphasizing key points?
How well were the objectives of the
session met?
Summation of the ratings
3
2 1 0 3
2 1 0 3
2 1 0
3
2 1 0 3
2 1 0 3
2 1 0
6
7
8
9
10
11
In your opinion, how would you rate
the overall effectiveness of this
trainer?
12
Please describe your meeting with
this trainer and the key issues
discussed.
Any additional comments:
13
Overall, add all
individual ratings
per session out of
81:_____________
66 – 81 = Can train independently
54 – 65 = Can train with support
27 – 53 = Can train after mentorship
0 – 26 = Cannot train
52
Download