Concept Mapping: An Introduction to Structured Conceptualization William Trochim Cornell University What is concept mapping? A method that... Focuses and helps objectify the group planning process Helps individuals think as a group... ...without losing their individuality Helps groups to manage complexity... ...without trivializing or losing detail In about 4 hours of participant time a group can... ...Brainstorm a large set of issues... • innovations in way network is delivered • (investigate) corporate/structural alignment • assist in the development of non-traditional partnerships (Rehab with the Medicine Community) • expand investigation and knowledge of PSN'S/PSO's • continue STHCS sponsored forums on public health issues (medicine managed care forum) • inventory assets of all participating agencies (providers, Venn Diagrams) • access additional funds for telemedicine expansion • better utilization of current technological bridge • continued support by STHCS to member facilities • expand and encourage utilization of interface programs to strengthen the viability and to improve the health care delivery system (ie teleconference) • discussion with CCHN brainstorm • innovations in way network is delivered • (investigate) corporate/structural alignment • assist in the development of non-traditional partnerships (Rehab with the Medicine Community) • expand investigation and knowledge of PSN'S/PSO's • continue STHCS sponsored forums on public health issues (medicine managed care forum) • inventory assets of all participating agencies (providers, Venn Diagrams) • access additional funds for telemedicine expansion • better utilization of current technological bridge • continued support by STHCS to member facilities • expand and encourage utilization of interface programs to strengthen the viability and to improve the health care delivery system (ie teleconference) • discussion with CCHN sort Decide how to manage multiple tasks. 20 Manage resources effectively. 4 Work quickly and effectively under pressure 49 Organize the work when directions are not specific. 39 ...organize the issues... rate brainstorm • innovations in way network is delivered • (investigate) corporate/structural alignment • assist in the development of non-traditional partnerships (Rehab with the Medicine Community) • expand investigation and knowledge of PSN'S/PSO's • continue STHCS sponsored forums on public health issues (medicine managed care forum) • inventory assets of all participating agencies (providers, Venn Diagrams) • access additional funds for telemedicine expansion • better utilization of current technological bridge • continued support by STHCS to member facilities • expand and encourage utilization of interface programs to strengthen the viability and to improve the health care delivery system (ie teleconference) • discussion with CCHN …”map” the issues... organize sort Decide how to manage multiple tasks. 20 Manage resources effectively. 4 Work quickly and effectively under pressure 49 Organize the work when directions are not specific. 39 Information Services rate Technology Community & Consumer Views Regionalization Management Financing STHCS as model • better utilization of current technological bridge (8) • expand and encourage utilization of interface programs to strengthen the viability and to improve the health care delivery system (ie teleconference) (10) • patient information system to be shared by all members (19) • the STHCS will assess the status of all participant organization interface technology development and needs (20) • teleconference board meeting (21) • development of interface technology (30) • continued advancement of tech interface (44) • assure 100% board member access to wide area network (46) • utilize the televideo telecommunication, telemedicine to share resources/strengths (50) • establishment of a virtual network -- as an intranet originally and eventually an internet solution (61) Information Services Technology Community & Consumer Views Regionalization Financing Management STHCS as model brainstorm • innovations in way network is delivered • (investigate) corporate/structural alignment • assist in the development of non-traditional partnerships (Rehab with the Medicine Community) • expand investigation and knowledge of PSN'S/PSO's • continue STHCS sponsored forums on public health issues (medicine managed care forum) • inventory assets of all participating agencies (providers, Venn Diagrams) • access additional funds for telemedicine expansion • better utilization of current technological bridge • continued support by STHCS to member facilities • expand and encourage utilization of interface programs to strengthen the viability and to improve the health care delivery system (ie teleconference) • discussion with CCHN Information Services organize Technology sort Decide how to manage multiple tasks. 20 Community & Consumer Views Manage resources effectively. 4 Work quickly and effectively under pressure 49 Organize the work when directions are not specific. 39 Regionalization rate map Information Services Technology Community & Consumer Views Regionalization Financing Management Management Mission & Ideology STHCS as model Financing ...prioritize the issues... brainstorm • innovations in way network is delivered • (investigate) corporate/structural alignment • assist in the development of non-traditional partnerships (Rehab with the Medicine Community) • expand investigation and knowledge of PSN'S/PSO's • continue STHCS sponsored forums on public health issues (medicine managed care forum) • inventory assets of all participating agencies (providers, Venn Diagrams) • access additional funds for telemedicine expansion • better utilization of current technological bridge • continued support by STHCS to member facilities • expand and encourage utilization of interface programs to strengthen the viability and to improve the health care delivery system (ie teleconference) • discussion with CCHN Counties 1 & 2 County 3 4.23 4.4 Mission & Ideology Mission & Ideology organize Decide how to manage multiple tasks. 20 Financing Financing sort Technology Regionalization Manage resources effectively. 4 Work quickly and effectively under pressure 49 Organize the work when directions are not specific. 39 Regionalization Management Information Services Information Services Management Community & Consumer Views rate Community & Consumer Views Technology map Information Services 3.55 3.56 Technology r = .72 Community & Consumer Views Regionalization prioritize Information Services Technology Community & Consumer Views Management STHCS as model Financing Regionalization ...examine consensus... Financing Management Mission & Ideology brainstorm • innovations in way network is delivered • (investigate) corporate/structural alignment • assist in the development of non-traditional partnerships (Rehab with the Medicine Community) • expand investigation and knowledge of PSN'S/PSO's • continue STHCS sponsored forums on public health issues (medicine managed care forum) • inventory assets of all participating agencies (providers, Venn Diagrams) • access additional funds for telemedicine expansion • better utilization of current technological bridge • continued support by STHCS to member facilities • expand and encourage utilization of interface programs to strengthen the viability and to improve the health care delivery system (ie teleconference) • discussion with CCHN Feasibility 5 organize sort Decide how to manage multiple tasks. 20 Manage resources effectively. 4 76 75 25 Work quickly and effectively under pressure 49 33 34 Organize the work when directions are not specific. 39 2.6 62 22 37 10 17 1 45 1.8 rate 1.2 2.47 map Information Services …and “drill back down” to details for prioritizing action Technology Community & Consumer Views prioritize Regionalization Information Services Technology 4.23 Community & Consumer Views Management Importance 4.4 STHCS as model Financing Regionalization 3.55 Financing Management Mission & Ideology r = .72 3.56 4.8 Concept Mapping Process Concept Mapping (Sorting input) To organize the issues Measurement (Rating input) To observe expectations and results Pattern Matching and Go Zones To link expectations and results, importance and capacity Concept Mapping to organize Uses information from individuals to: • • • • identify group shared vision represent group ideas pictorially encourage teamwork facilitate group decision making To begin… 1. Prepare Project: Develop a focus “A specific issue that is relevant to the mental health of women and girls is . . ." ...focus Participants Contribute Knowledge and Opinion 1. Prepare Project • Body image issues- (breast size, hair color/texture, nose, other physical features vs external valuation of "beauty"). (9) • The development and evaluation of Internetbased interventions that can be accessed by women anywhere, anytime. (31) • The impact of race, ethnicity, culture, class, sexual orientation and age on the expression of symptoms. (54) • Lack of encouragement and opportunity at the elementary, middle and high school levels for career opportunities that girls can aspire to. (61) • Lack of parity for mental health care coverage. (102) 2. Generate Ideas Participants Build the Conceptual Framework 1. Prepare Project sort Decide how to manage multiple tasks. 20 Organize the work when directions are not specific. 39 Manage resources effectively. 4 Work quickly and effectively under 2. Generate Ideas 3. Structure Ideas rate The Process Turns Knowledge into Data 1. Prepare Project Technology Community & Consumer Views Financing Informatio n Services Regionalization Management Mission & Ideology Area 1 Area 2 4.22 Mission & Ideology Financing Financing Regionalization Technology Management Regionalization Information Services Information Services Community & Consumer Technology 3.47 2. Generate Ideas 4.4 Mission & Ideology Management r = .51 Community & Consumer 3.56 3. Structure Ideas 4. Compute Maps And Data Into Meaning 1. Prepare Project Technical Issues Processes/ Methodology Graphical User Interface Documentation Client Issues Change Control Personal Awareness & Skill Team Issues Management 2. Generate Ideas 5. Interpret Maps 3. Structure Ideas 4. Compute Maps Meaning Into Action, Policy, and Evaluation 1. Prepare Project 6. Utilize Maps Area 1 Area 2 4.22 Mission & Ideology Mission & Ideology Financing Financing Regionalization Technology Management Regionalization Information Services Information Services Community & Consumer Views Management Technology 3.47 5. Interpret Maps 2. Generate Ideas 4.4 Community & Consumer Views r = .51 3.56 3. Structure Ideas 4. Compute Maps The emerging structure… Workforce Transportation Housing Continuum Capacity of Community Services Caregiving Special Needs & Mental Health Access to Benefits Gerotechnology Communication Impairments Economic Security Attitudes Towards Aging Engaged Lifestyle …contains all the details and provides a conceptual framework. How Did We Build These Results? • The Raw Materials: – Statements – Sort Input from each participant • The Tools – – – – – Aggregation of Sort Data Similarity Matrix Multidimensional Scaling Hierarchical cluster analysis Anchoring/Bridging Analysis Representation Sort for one participant Binary, square similarity matrix Total square similarity matrix across participants Multidimensional Scaling 5 1 2 4 0 1 1 3 1 0 1 5 0 0 0 1 0 0 2 0 2 0 5 3 0 0 0 0 0 0 4 0 3 5 0 0 0 0 0 0 0 0 0 0 5 0 0 2 0 0 1 1 0 0 0 5 0 0 4 0 1 0 0 0 0 0 5 0 0 0 3 0 0 0 2 0 0 5 0 0 1 2 0 0 0 4 0 0 5 0 0 0 0 0 0 0 0 0 0 5 Input: A square matrix of relationships among a set of entities 13 3 17 16 22 24 23 27 43 12 50 25 38 26 52 8 44 6 36 37 18 41 29 30 34 7 35 51 47 31 42 10 Output: An n-dimensional mapping of the entities 54 28 33 45 32 14 39 1 40 49 4 20 48 55 46 56 19 53 11 15 21 5 9 Multidimensional Scaling Similarity Matrix 1 2 3 1 5 1 2 2 1 5 0 If 4 out of 5 people grouped statement 1 with 2 3 2 0 5 If 3 out of 5 people grouped statement 1 with 2 If 2 out of 5 people grouped statement 1 with 2 1 If 1 out of 5 people grouped statement 1 with 2 If 0 out of 5 people grouped statement 1 with 2 Multidimensional Scaling Similarity Matrix 1 2 3 1 5 1 2 2 1 5 0 3 2 0 5 2 1 Multidimensional Scaling Similarity Matrix 1 2 3 1 5 1 2 2 1 5 0 3 2 0 5 3 2 1 3 Multidimensional Scaling Similarity Matrix 1 2 3 4 1 5 1 2 4 2 1 5 0 0 3 2 0 5 3 4 4 0 3 5 3 2 4 1 Multidimensional Scaling Similarity Matrix 1 2 3 4 1 5 1 2 4 2 1 5 0 0 3 2 0 5 3 4 4 0 3 5 y 3 A map can be depicted as a coordinate matrix 1 2 3 4 Coordinate Matrix x y 2.8 1.0 5.9 3.2 1.1 3.2 1.9 1.3 2 4 1 x Multidimensional Scaling Similarity Matrix 1 2 3 4 1 5 1 2 4 2 1 5 0 0 3 2 0 5 3 4 4 0 3 5 y 3 A map can be depicted as a coordinate matrix 1 2 3 4 Coordinate Matrix x y 2.8 1.0 5.9 3.2 1.1 3.2 1.9 1.3 2 c 4 1 b a x And from the coordinates we can compute the distances between all pairs of points a2 + b2 = c2 a = difference between x values b = difference between y values c = distance Multidimensional Scaling Distance Matrix Similarity Matrix 1 2 3 4 1 5 1 2 4 2 1 5 0 0 3 2 0 5 3 4 4 0 3 5 y 1 2 3 4 3 A map can be depicted as a coordinate matrix 1 2 3 4 Coordinate Matrix x y 2.8 1.0 5.9 3.2 1.1 3.2 1.9 1.3 1 0.0 3.2 2.8 1.1 2 3.2 0.0 4.8 4.6 3 2.8 4.8 0.0 2.1 4 1.1 4.6 2.1 0.0 2 4 1 And can show these as a matrix of distances between points x And from the coordinates we can compute the distances between all pairs of points a2 + b2 = c2 a = difference between x values b = difference between y values c = distance Multidimensional Scaling Stress Similarity Matrix 1 2 3 4 1 5 1 2 4 2 1 5 0 0 3 2 0 5 3 4 4 0 3 5 y 3 A map can be depicted as a coordinate matrix 1 2 3 4 Coordinate Matrix x y 2.8 1.0 5.9 3.2 1.1 3.2 1.9 1.3 Distance Matrix Is the relationship between the similarity input matrix and the distances on the map 1 2 3 4 1 0.0 3.2 2.8 1.1 2 3.2 0.0 4.8 4.6 3 2.8 4.8 0.0 2.1 4 1.1 4.6 2.1 0.0 2 4 1 And can show these as a matrix of distances between points x And from the coordinates we can compute the distances between all pairs of points a2 + b2 = c2 a = difference between x values b = difference between y values c = distance Multidimensional Scaling Stress Similarity Matrix 1 2 3 4 1 5 1 2 4 2 1 5 0 0 3 2 0 5 3 4 4 0 3 5 Is the relationship between the similarity input matrix and the distances on the map Similarities 1,1 1,2 1,3 1,4 2,2 2,3 2,4 3,3 3,4 4,4 5 1 2 4 5 0 0 5 3 5 Distance Matrix 1 2 3 4 1 0.0 3.2 2.8 1.1 Distances Low stress values means there is a greater correspondence between the similarities and the map 1,1 1,2 1,3 1,4 2,2 2,3 2,4 3,3 3,4 4,4 0.0 3.2 2.8 1.1 0.0 4.8 4.6 0.0 2.1 0.0 2 3.2 0.0 4.8 4.6 3 2.8 4.8 0.0 2.1 4 1.1 4.6 2.1 0.0 Multidimensional Scaling • Directionality – Does MDS know North from South? • Dimensionality – Why only two dimensions? • Stress – How much does it really matter? Cluster Analysis • Hierarchical – clusters get built in a tree-like method • Agglomerative – builds toward all items in one pile (divisive - all start in one and divide) • Clustering criterion – the rule used to decide the next cluster merge – Ward’s algorithm • Number of Clusters Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged Number of Clusters 1 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 Number of Clusters 1 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 Number of Clusters 1 2 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 9 + 10 Number of Clusters 1 2 3 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 9 + 10 (1 + 6) + 8 Number of Clusters 1 2 3 4 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 9 + 10 (1 + 6) + 8 3+4 Number of Clusters 1 2 3 4 5 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 9 + 10 (1 + 6) + 8 3+4 2 + (9 + 10) Number of Clusters 1 2 3 4 5 6 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 9 + 10 (1 + 6) + 8 3+4 2 + (9 + 10) ((1 + 6) + 8)) + (3 + 4) Number of Clusters 1 2 3 4 5 6 7 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 9 + 10 (1 + 6) + 8 3+4 2 + (9 + 10) ((1 + 6) + 8)) + (3 + 4) (5 + 7) + ((2 + (9 + 10)) Number of Clusters 1 2 3 4 5 6 7 8 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 Cluster Analysis 7 5 8 1 9 10 6 2 3 4 Merge Points Merged 1+6 5+7 9 + 10 (1 + 6) + 8 3+4 2 + (9 + 10) ((1 + 6) + 8)) + (3 + 4) (5 + 7) + ((2 + (9 + 10)) (((1 + 6) + 8)) + (3 + 4)) + (5 + 7) + ((2 + (9 + 10)) Number of Clusters 1 2 3 4 5 6 7 8 9 1 10 9 8 7 6 5 4 3 2 1 6 8 3 4 7 5 9 10 2 What is the Bridging Value? tells you whether the statement was sorted with others that are close to it on the map or whether it was sorted with items that are farther away on the map. The Bridging Value • Helps us interpret what content is associated with specific areas of the map • Statements with lower bridging values are generally better indicators of the meaning of their part of the map than statements with higher bridging values • Statements with higher bridging values means statement is a bridge between different areas on map Compute Bridging Values • A bridging value always ranges from 0 to 1 • The bridging values are computed after the map is computed. • The cluster bridging value is simply the average bridging value across all statements in a cluster. Bridging Value, Step 1 1. We begin by computing the proportion of sorters who put point i and j together in a pile: pij sij m where sij = number of sorters who placed point i and j together in the same pile m = total number of sorters pij = proportion of sorters who placed point i and j together in the same pile Bridging Value, Step 2 2. We compute the Euclidean Distance between all pairs of standardized points: d ij ( xi x j ) 2 ( yi y j ) 2 Where xi = MDS x-coordinate for point i yi = MDS y-coordinate for point i xj = MDS x-coordinate for point j yj = MDS y-coordinate for point j dij = standardized Euclidean Distance between points i and j Bridging Value, Step 3 3. We compute the unstandardized bridging value: n bi j 1 ( pij * d ij ) n p j 1 ij where bi = bridging raw value for point i pij = proportion of sorters who placed point i and j together in the same pile dij = standardized Euclidean Distance between points i and j Bridging Value, Step 4 4. Normalize the bridging raw value: bi min( b) bi max( b) min( b) Where bi min(b) max(b) bi = = = = bridging raw value for point i minimum of the bi values maximum of the bi values standardized bridging value Sort Pile Label Analysis • finds the “best fitting” sort pile label for a cluster • done after the map is computed • based on centroid computations Sort Pile Label Analysis What is a centroid? 3 43 Y 50 36 41 37 X Sort Pile Label Analysis What is a centroid? 3 43 Y 50 36 41 37 X Sort Pile Label Analysis What is a centroid? Average Y 3 43 50 36 X 41 37 Average X Sort Pile Label Analysis 13 3 2 16 43 27 22 50 18 12 25 x36 37 24 23 17 26 52 8 44 6 x 38 41 Cluster Centroid 29 distance Pile Centroid 51 47 31 7 42 10 45 33 28 32 14 39 50, 36, 43, 3, 13, 16, 29 34 35 54 Your Pile: 30 1 40 49 4 48 46 56 19 20 55 53 11 15 21 5 9 Sort Pile Label Analysis • Every cluster has a centroid • Every sort pile has a centroid – the average x,y for all items in the pile – this is the best location on the map for the pile label – can compute the distance between this label and any other point on the map • For each cluster – compare distance between its centroid and each sort pile centroid – best sort pile label is the closest one Cluster Map with Labels Workforce Transportation Special Needs & Mental Health Housing Continuum Capacity of Community Services Caregiving Access to Benefits Impairments Gerotechnology Economic Security Communication Attitudes Towards Aging Engaged Lifestyle Importance Housing Continuum Workforce Capacity of Community Services Transportation Caregiving Access to Benefits Special Needs & Mental Health Impairments Communication Gerotechnology Attitudes Towards Aging Layer Value 1 3.62 to 3.79 2 3.79 to 3.95 3 3.95 to 4.12 4 4.12 to 4.29 5 4.29 to 4.46 Engaged Lifestyle Economic Security Feasibility Housing Continuum Workforce Transportation Caregiving Capacity of Community Services Access to Benefits Special Needs & Mental Health Communication Gerotechnology Impairments Attitudes Towards Aging Layer Value 1 2.98 to 3.11 2 3.11 to 3.23 3 3.23 to 3.35 4 3.35 to 3.47 5 3.47 to 3.59 Economic Security Engaged Lifestyle Importance Importance 4.46 Economic Security Housing Continuum Workforce Access to Benefits Transportation Workforce Capacity of Community Services Impairments Caregiving Communication Housing Continuum Special Needs & Mental Health Capacity of Community Services Transportation Caregiving Special Needs & Mental Health Communication Gerotechnology Impairments Attitudes Towards Aging Attitudes Towards Aging Gerotechnology Engaged Lifestyle 3.62 Access to Benefits Layer Value 1 3.62 to 3.79 2 3.79 to 3.95 3 3.95 to 4.12 4 4.12 to 4.29 5 4.29 to 4.46 Engaged Lifestyle Economic Security Feasibility Feasibility 3.59 Communication Housing Continuum Workforce Transportation Caregiving Capacity of Community Services Special Needs & Mental Health Access to Benefits Transportation Communication Gerotechnology Impairments Attitudes Towards Aging Layer Value 1 2.98 to 3.11 2 3.11 to 3.23 3 3.23 to 3.35 4 3.35 to 3.47 5 3.47 to 3.59 Economic Security Engaged Lifestyle Engaged Lifestyle Impairments Special Needs & Mental Health Capacity of Community Services Attitudes Towards Aging Gerotechnology Workforce Caregiving Housing Continuum Access to Benefits Economic Security 2.98 Importance vs. Feasibility Importance Feasibility 4.46 3.59 Economic Security Communication Access to Benefits Transportation Workforce Capacity of Community Services Impairments Caregiving Communication Housing Continuum Special Needs & Mental Health Transportation Engaged Lifestyle Impairments Special Needs & Mental Health Capacity of Community Services Attitudes Towards Aging Gerotechnology Workforce Attitudes Towards Aging Caregiving Housing Continuum Access to Benefits Economic Security Gerotechnology Engaged Lifestyle 3.62 r = -.27 2.98 Comparing each Unique Statement on Importance and Feasibility: Go Zones High the number of senior community centers in outer boroughs and their ability to handle influx (1) Feasibility 1 3 2 research funding for Alzheimer's (4) 4 Low Low Importance High affordable opportunities for recreation / entertainment/ socialization for seniors, including access to fitness and wellness programs (3) homecare services during holidays and vacations (2) Cluster mean of each scale is used to divide the matrix Features of Concept Mapping • guides project throughout life-cycle - beginning to end • involves many stakeholder groups throughout the entire training life-cycle • easily scalable and transferable • uses state-of-the-art analytical tools to provide rigor and credibility Benefits of Concept Mapping • visual product is easy to understand and present • identifies disconnects before significant investments are made • offers significant cost savings while improving the quality of project