PARTICIPANT EVALUATIONS FOR September 28, 2004 Leadership Forum INSTITUTE FOR THE STUDY OF PUBLIC POLICY IMPLEMENTATION Strongly agree FORMAT: 1. The meeting format fostered an exchange of ideas. 2. The meeting fostered an understanding of stakeholder issues other than mine. 3. The meeting created an opportunity to meet other stakeholders. Agree 10 8 10 4 6 4 7 5 7 5 6 4 Neither agree nor disagree SUSBTANCE: 5. The meeting provided me information concerning what constitutes an effective balanced scorecard. Why or why not? I’ve seen BSC before, so this wasn’t new, but it was a good reminder/refresher. Implementation lessons from Tom Tolley was very helpful. Yes, good case studies in balanced scorecard management. More emphasis on criteria for selecting measures would be useful. Speakers dealt with different perspectives, different levels of players/measure, requirements necessary for effective implementation. Good discussion of the concept and real time learning from others who have been successful. Both presentations gave me a broad view of the obstacles and how BSC is in “real life.” Real life examples from agencies. Examples of appropriate measures. General theoretical info was provided and then backed up by case examples. 6. The meeting provided me with information concerning how a balanced scorecard can be used to improve agency performance. Why or why not? The second speaker Tom gave a very good example of this. Participants discussed their own experiences/organizational situations. GSA example worked well. Tom provided excellent advice. To link budget to performance – it was a good insight. Showed relationship between balanced scorecard and meeting agency goals. Good case examples – diverse examples. I got insight into the BSCs of other agencies. A little frustrating developing the BSC. Each agency seems to be fairly different. 7. The meeting provided me with information concerning how a balanced scorecard may assist an agency in its strategic planning effort. Why or why not? I didn’t see that effectively in the form… unless creating measures is a means of developing strategic plans. It would be beneficial to learn more of the step by step procedure to form and implement it. Message! You need to start somewhere and grow the system. I like the idea on putting money to achieving the goals. I believe the focus was more broad. 8. .My expectations were met. Y - 14 N-0 Yes No 2 Disagree Strongly disagree 9. I liked most: Audience participation; practical “business cases.” Learning from the experiences of others present who represented different organizations. John Tolley’s practical lessons learned. Suggestions on effective implementation. Very nice atmosphere. Measures to drive performance. The format – it allows to meet other people, from other agencies, with different expectations. Tolley’s showing of PBS experience and how they achieved cost savings and measured performance over time. 10. I liked least: The intro – didn’t catch my attention. Small turnout. The presentations were a little bit short. 11. Suggestions for future meetings: Describe potential impediments for implementation and identify key success factors. Can drill down further into Balanced Scorecard with working session hookup with PMA; a session on metrics. Have group discussion around the specific “case study” that focuses on a real life challenge around performance measures or related issues. Benchmarking opportunities.