Assessment Report – 2010 Evidence collected in spring & fall 2010 Report due March 31, 2011 Directions: Please complete a form for each of the programs within your department. This form was designed to provide a format for assessment reporting and should not be used to limit the amount of information provided. Each box that is attached to each of the sections is designed to adjust to varying lengths. If you have any questions, please contact Dr. Bea Babbitt at x51506 or via email. ***Email form to assessment@unlv.edu (Academic Assessment/UNLV) Program Information: Program Advanced Education in Pediatric Dentistry (Certificate Program) Department(s) Pediatric Dentistry College UNLV School of Dental Medicine Program Assessment Coordinator Jeanne A. Hibler, DDS, Program Director Report submitted by (include phone/email) Jeanne A. Hibler, DDS, Program Director / Tel: 702-774-2414 / jeanne.hibler@unlv.edu Date Submitted 1. Student Learning Outcomes for the program. List the Student Learning Outcomes for the program. Number for later reference. 1. 2. 3. 4. 5. 6. Demonstrate in-depth knowledge of biomedical, professional, and clinical sciences in relation to pediatric dentistry. Develop outstanding clinical skills to allow quality patient care and service. Achieve competencies required for Board Certification. Demonstrate competence in the provision of didactic and clinical instruction for educational purposes. Develop and demonstrate the ability to complete a quality research project. Demonstrate cultural sensitivity when serving underserved populations in the state of Nevada. 1 2. Planned assessments: Methods, Instruments and Analysis. According to the Assessment Plan for this program, what were the planned assessments to be conducted during the Spring & Fall 2010 Academic Semesters? Assessment Instrument (e.g., survey, exit exam) Learning outcome(s) assessed (list by #) Expected Measures (results that would indicate success) *Course grades 1, 2, &5 *Satisfactory completion of all didactic courses (Grades above 80%) *Clinical Evaluations 1, 2, &6 *Average or above average clinical evaluation scores from faculty (Above 50%) *All residents completing adequate numbers of special needs patients (Minimum of 5/year/resident) *Completion of adequate numbers of OR cases per CODA (Minimum of 20 OR cases within the 24-month period) *All residents providing quality care in a timely manner (Individual resident production within 20% of average resident production for each year of residency) *Presentations 1 *Completion of quality assigned presentations in didactic courses by all residents (100%) *Participation 3, 4, &6 *All residents participating in AAPD or local dental association meetings (100%) *All residents participating in teaching roles in clinical or didactic training sessions (At least 5 % of total program time) *Residents participating in community service activities (Minimum of 5/year/resident) *Resident completion of assigned community clinical rotations encompassing provision of care to underserved populations (100% of residents completing rotations) 2 *Hospital/Off-site Rotation Evaluations 2 *All residents (100%) functioning satisfactorily in the hospital setting *Project Completion 5 *Completion of at least one research project/resident/ 24-month period *All residents presenting projects in formal settings during the 24-month period *All residents submitting a research paper for publication during the 24-month period *In-Service Exams and Board Exams 3 *Graduates passing the AAPD Qualifying Exam for Board Certification *Graduates scoring within 10 % of the National Average on the AAPD In-Service Exams 3 3. Results, conclusions and discoveries. What are the results of each planned assessment listed above? Is the outcome at, above, or below what was expected? What conclusions or discoveries do you draw from the results? Describe below or attach to the form. Course Grades: All residents received final passing Course Grades in the 80 - 100% range. All residents met program expectations. The soon-to-graduate Y2 residents in the Spring Semester achieved significantly higher grades, indicating an elevated knowledge base, as expected later in the program. As the program continues to accept residents with higher Dental School GPAs and higher National Board Scores, this trend may change. Clinical Evaluations: All residents received clinical evaluation scores from faculty above 50%. For Y2 residents in the Spring Semester, evaluation scores ranged from 83.0 - 88.8% with an average score of 86.4%. Y2 resident scores ranged from 71.3-84.9% with an average score of 77.0%. The average Y2 resident scores were significantly higher than Y1 resident scores (86.4%/77.0%), indicating a higher level of competence in the senior group, as expected. All Y2 residents treated adequate numbers (minimum of five/resident) of special needs patients. However, the Y1 residents were later getting into clinic in the Fall of 2010 due to delayed State Dental Licensing and a change in the dental software system requiring cancellation of clinical activity during the transition. This resulted in the Y1s having a decrease in clinical activity during this time and a decrease in treatment of all patients, including very few special needs patients during their first semester in the program. These residents will very likely complete treatment on more than 5 special needs patients during their 2nd Semester 2011. At the end of the Fall Semester 2010, all the Y2 residents had completed over 20 OR cases with an average of 31.5/resident. Y1 residents do not begin OR treatment until their 2nd semester, but they do observe treatment in the OR. At the end of the Fall Semester, 2010 the Y1 residents observed an average of 3.7 OR cases/resident. Residents are on track to complete adequate numbers of OR cases to be competent in this area. The average resident production for Y1 residents in Spring Semester 2010 was $27,044 with only one resident below 20% of average production for Y1s. One resident was below 34% of the average production, at $17,784 for this semester. The average resident production for Y2 residents was $25,475 with all residents within 20% of average production for Y2s. Individual variations in productivity are affected by rotation schedules (more in the senior year) as well as patient numbers, staff effectiveness, and clinic organization. In the Fall Semester, the Y2 residents (the previous semester's Y1 residents) produced an average of $34,341 with all Y2 residents within 20% of average production for Y2s. This shows that the least productive Y1 resident in the first year caught up in the following semester with the 4 3. Results, conclusions and discoveries (cont.) rest of his class in productivity. The average production for the Y1 residents was $16,181. All but two of the Y1 residents were within 20% of the average Y1 production. These residents were the last residents to receive their state board license, thus limiting their clinical experiences in the Fall Semester. One resident was 30.7 % of average production, while one resident was at 23.2 % of average production for the Y1 class. This indicates the need for first year residents to obtain their state licensure as soon as possible, in order to obtain optimal clinical experiences in their first semester of residency. Presentations: 100% of residents prepared and presented their assigned presentations in a quality format including visual materials and power point presentations. These presentations were part of the Intro to Pediatric Dentistry and Pediatric Clinical Seminars Courses, including 3-8 presentations/resident/course. Participation: 100% of residents participated in American Academy of Pediatric Dentistry (AAPD) and local Pediatric Dentistry Study Club meetings. All Y1 residents completed the Hospital Dentistry and Conscious Sedation Courses sponsored by the AAPD, while all Y2 residents completed the Comprehensive Review of Pediatric Dentistry Course sponsored by the AAPD. All residents have completed and maintained PALS certification. Residents begin teaching roles after the 2nd semester of their first year. The Y2 residents all participated in the Pre-doctoral Pediatric Dentistry Course in the pre-clinical lab and in the didactic portion during at least one lecture/resident. Y2 residents also served as clinical instructors in the Pre-doctoral clinic sessions along with a pediatric attending on an assigned rotational basis. The time allotted to teaching roles was slightly less (3.8 %) than 5 % of total program time. Total time allotted to teaching roles needs to increase. 100% of residents participated in community service activities. Y1 residents in the Fall Semester were more active in this area, participating in an average of 8 activities/resident. Y2 residents were less active, with a range of 2-6 activities/resident. This is partly due to the set curriculum, with Y1 residents having more time allotted for these activities as well as utilizing Y1 students more often for public relations and oral health education activities. Activities included Community Health Fairs, Head Start screenings, WIC education, UMC education programs for pregnant mothers, Give Kids A Smile, Saturday Children's Clinic, Clark Country School screenings, and other oral health presentations for elementary schools. The over-all participation time in community service activities is more than adequate. 100% of residents completed their mandatory clinical rotations in the community. All Y1 residents in the Spring Semester of 2010 completed a two-week rotation in a Tribal Clinic. Beginning in the Fall Semester of 2010, all residents provided dental services at the local Paiute Tribal 5 3. Results, conclusions and discoveries (cont.) Clinic in Las Vegas each week on a rotational basis. All Y2 residents completed a 2-week rotation to the Children's Center for Blood Disorders and Cancer as well as participating in the Multidisciplinary Clinics for Bleeding Disorders each month. All residents participated in the Cleft Lip and Palate Clinic on a rotational basis. All residents completed their assigned rotations to the Paradise Community Dental Clinic, an on-going weekly rotation. Hospital Rotation Evaluations: 100% of residents received satisfactory evaluations on mandatory hospital rotations and functioned satisfactorily in the hospital setting. During 2010, all Y2 residents completed 2-week hospital rotations in Pediatric Medicine and Emergency Medicine at University Medical Center's Children's Hospital of Nevada, as well as a 4-week rotation in Anesthesia. All residents provided On-Call Emergency services on a rotational basis at UMC's Children's Trauma Center. These rotations provide adequate training for functioning in a hospital setting as a pediatric dentist. Project Completion: All Y2 residents in the Spring Semester of 2010 completed individual research projects. Each of these four residents had presented their projects in formal settings, both in an Oral Presentation with PowerPoint and in a Poster Presentation format at the Annual California State Pediatric Dental Meeting as well as the Annual AAPD Meeting. Some of the Y1 residents, however, were slow to initiate their projects during this semester. Two of the Y1 residents presented projects at the Annual AAPD Meeting. Increased monitoring and mentorship of the first year residents is needed for them to complete their research projects in a timely manner and to enable them to be prepared to present their projects at national and local meetings. AAPD In-Service and Qualifying Board Examinations: This residency program initially participated in the AAPD In-Service Examination in the summer of 2009. Therefore during the 2010 year, only the Y1s participated in the Initial/ Pre-Program Exam. One resident scored in the 90th percentile, three residents were above the national average score for entering residents and three were below the average national score. The current Y2s will be taking the Final/ Post Program Exam in April of 20ll. At this time, it will be possible to compare their scores from the beginning of the program to the end. All Y2 residents took the AAPD Qualifying Exam for Board Certification in May of 2010. All four graduating residents passed this examination. This is an outstanding accomplishment for a new program and for the first graduating class. 6 4. Use of results. What program changes are indicated, and how will they be implemented? Include a description of who will review and act on the findings. If none, describe why changes are not needed. Based on this evaluation, the following changes are indicated: In-coming residents need to obtain their state dental licenses sooner in order to increase their clinical experiences during their first semester. Attention to providing increased email reminders by the Program Director to up-coming residents may be helpful. The new dental software has now been implemented and most of the patient records have now been entered into the new software, allowing the clinic to function more effectively. These changes should allow the first year residents to gain increased clinical experience. The amount of time in resident teaching roles needs to increase up to 5% of program time. This goal will be achieved by combining the pre-doctoral and residency clinics so the residents will participate more in pre-doctoral clinical training. Plans are already being implemented by the Program Director and the Pediatric Pre-doctoral Director. Year One (Y1) residents require increased mentoring and monitoring of individual research projects. A requirement by the Director of Research for a spring oral presentation of individual projects (as was done during the first year of the program) may encourage first year residents to progress in a timely manner. Also, increased mentoring and progress reporting to the Director of Research may improve resident progress and allow residents to be prepared for presentations and potential awards at national meetings. 7 5. Progress. Describe program changes that have been recommended in past reports. What progress has been made since the recommendation? Increase the resident applicant pool. Modifications were made to improve the web page for the program. Both the PASS and MATCH Services were utilized in the application process. This resulted in over 100 applications for the last two interview sessions. Improve course content in areas of research methodology, speech pathology, psychology, and oral surgery. The course director for PGDE 8702 increased instruction in biostatistics and research methodology. The research director provided additional assistance in obtaining necessary IRBs. The program director added additional content to the Clinical Seminars Course in the areas of Speech pathology and psychology. A professional in Speech Pathology provided a guest lecture to compliment the assigned readings in this area. The Program Director provided three additional hours of lecture regarding psychology, clinical management and treatment of various conditions, and dental implications. Dr. Daniel Orr provided additional guest lectures in pediatric oral surgery and Dr. Andy Ingel provided a hands-on lecture on Suturing Techniques. Increase resident exposure to and treatment of special needs patients. An on-going rotation was established with the Children's Oncology and Hematology Clinic of Las Vegas. This association has allowed the residents to see first-hand how these diseases are clinically evaluated and managed. They are then able to complete needed dental treatment and follow-up care for these children either in the residency clinic or in the hospital setting. This has greatly increased residents' abilities in managing medically compromised children. Increase the number of pediatric attending faculty to allow for additional clinical experiences. An additional Full-Time Faculty member was added, although three Part-Time Faculty resigned. Two pediatric dentists in the community became Adjunct Faculty to cover residents in the community clinic setting. 8