Findings and observations on BIM/VDC ! CIFE, Stanford University © 2014! Project Methodology! Data Collection! ! • Out of 146 cases and ~200 evaluations! • 126 AEC project cases surveyed using the BIM/VDC Scorecard from 2011 to 2013! CIFE, Stanford University © 2014! Project Methodology! Data Collection! ! • 126 AEC project cases surveyed using the BIM/VDC Scorecard from 2011 to 2013! Distribution of Surveyed Projects! 55%! 45%! Construction or Pre-construction ! post-construction! by region! Percentage of projects! Percentage of projects! by construction phase! 56%! 44%! US! Non-US! CIFE, Stanford University © 2014! Project Methodology! Data Collection! ! • Out of 146 cases and ~200 evaluations! • 126 AEC project cases surveyed using the BIM/VDC Scorecard from 2011 to 2013! ! Data Analysis! ! • Spearman’s rank correlation test! • t-contrast test of group means! • Cluster analysis! CIFE, Stanford University © 2014! Presentation Scope! What is VDC being used for?! Who is using VDC?! What improves project performance and assist other BIM/VDC uses?! CIFE, Stanford University © 2014! Use of VDC/BIM ! Planning objectives can be broadly classified into 7 major categories by their purposes! 7 VDC/BIM categories:! ! 1. Cost performance! 2. Schedule performance! 3. Safety! 4. Project delivery! 5. Communication! 6. VDC management! 7. Facilities management! CIFE, Stanford University © 2014! Use of VDC/BIM ! Previous workshop participants have ranked the importance of setting objectives in each of the 7 categories! Most important objectives! Rank! Survey size: 10! 1! Cost! 2! Schedule! 3! Safety! 4! Project Delivery! 5! Communication! 6! VDC Management! 7! Facilities Management! CIFE, Stanford University © 2014! Use of VDC/BIM ! Previous workshop participants have ranked the importance of setting objectives in each of the 7 categories! Most important objectives! Rank! Most frequently established ! qualitative objectives! Most frequently established quantitative objectives! Survey size: 10! Survey size: 126! Survey size: 126! 1! Cost! Communication! Schedule! 2! Schedule! Project Delivery! Communication! 3! Safety! Schedule! Project Deliver! 4! Project Delivery! Facilities Management! Cost! 5! Communication! Cost! Facilities Management! 6! VDC Management! Safety! VDC Management! 7! Facilities Management! VDC Management! Safety! CIFE, Stanford University © 2014! Use of VDC/BIM ! Previous workshop participants have ranked the importance of setting objectives in each of the 7 categories! Most important objectives! Rank! Most frequently established ! qualitative objectives! Most frequently established quantitative objectives! Survey size: 10! Survey size: 126! Survey size: 126! 1! Cost! Communication! Schedule! 2! Schedule! Project Delivery! Communication! 3! Safety! Schedule! Project Deliver! 4! Project Delivery! Facilities Management! Cost! 5! Communication! Cost! Facilities Management! 6! VDC Management! Safety! VDC Management! 7! Facilities Management! VDC Management! Safety! CIFE, Stanford University © 2014! Average number of quantitative objectives per 100 projects! 35 ! 27 ! # of objectives! Use of VDC/BIM ! Results from the VDC Scorecard also indicate that AEC projects rarely have objectives in Safety or VDC Management! 26 ! 24 ! 19 ! 10 ! 4! Schedule performance! Communication! Project delivery! Cost performance! Facility performance! VDC management! Safety ! CIFE, Stanford University © 2014! From 2011-2013, there is an increasing trend for the number of established quantitative and qualitative objectives! Use of VDC/BIM ! Average number of Quantitative and Qualitative objectives planned per 10 projects! Quantitative Objectives! Qualitative Objectives! 66 ! # of objectives! 49 ! 41 ! 25 ! 16 ! 8! 2011! 2012! 2013! CIFE, Stanford University © 2014! Number of Cost, Communication, Schedule, and Project Delivery objectives established by AEC projects are increasing! 60! 50! # of objectives! Use of VDC/BIM ! Average number of Quantitative KPIs per 100 AEC projects! 40! 30! 20! 10! 0! 2011! Communication! 2012! Cost performance! 2013! Schedule performance! Project delivery! CIFE, Stanford University © 2014! Average number of Quantitative KPIs per 100 AEC projects! 40! 35! # of objectives! Use of VDC/BIM ! But number of established Safety, VDC Management, and Facility Management objectives did not show significant increase by year! 30! 25! 20! 15! 10! 5! 0! 2011! 2012! Facility performance! Safety ! 2013! VDC management! CIFE, Stanford University © 2014! Use of VDC/BIM ! Discussion Point: Why are we not tracking Safety and Management in VDC? CIFE, Stanford University © 2014! Use of VDC/BIM ! VDC/BIM use can also be classified into 5 types of modeling applications! Type! Description! Visualization tools! aids in understanding a design, component, or process ! Documentation tools! aid in generating, organizing, and presenting project-related documentation! Model-based analyses! are simulations used to model, understand and predict a variety of facility lifecycle issues! Integrated analyses! combine multiple analyses and disciplinespecific interests into a single analysis process ! Automation and Optimization ! involves software and hardware tools that automate design and construction tasks! CIFE, Stanford University © 2014! Use of VDC/BIM ! There is significant increase in percentage of modeling applications used for Documentation and Integrated Analysis from 2011 to 2012! Increase in percentage of model application types by year! (out of check list provided in the VDC Scorecard)! 2011! 2012! 67%! 56%! 53%! 40%! 34%! 23%! 31%! 25%! 15%! 15%! Visualization and Communication! Integrated Analysis! Documentation! Model-based Analysis! Automation & Optimation! CIFE, Stanford University © 2014! Use of VDC/BIM ! Benefits of BIM/VDC suggested by VDC Scorecard Data matches with an industry report conducted by McGraw Hill! McGraw Hill (2013) Smart Market Report:! ! 1. Reduced Cost! 2. Higher profitability ! 3. Higher productivity ! 4. Fewer RFIs! 5. Fewer unplanned changes! 6. Higher customer satisfaction ! 7. Less disruptions! VDC Scorecard Data:! ! 1. Less cost variance (less changes) ! 2. Higher productivity ! 3. Reduced total cost (Higher Profitability)! 4. Fewer errors and omissions! 5. Less schedule variance ! 6. Higher quality (less defects)! 7. Increased prefabrication or off-site construction ! CIFE, Stanford University © 2014! We see contrasting trends with respect to having VDC planning objectives and VDC standards. 1. Having objec8ve VDC planning is improving year 2. Incorpora8ng VDC standards is decreasing by year 2011 VDC Scorecard’s Division Score (0-­‐100%) Use of VDC/BIM ! ! 2012 2013 74% 60% 59% 49% 45% Objec8ve 42% Standard CIFE, Stanford University © 2014! Use of VDC/BIM ! Discussion Points: How do we improve effec=veness of VDC Guidelines and Standards? Data shows that we are not realizing the following VDC benefits: • Shorter total dura=on • Last responsible moment benefit (e.g. delayed decision making un=l last responsible moment) CIFE, Stanford University © 2014! Presentation Scope! Who is using VDC?! CIFE, Stanford University © 2014! Overall percentage of BIM/VDC involvement by participant/stakeholder! Overall BIM/VDC Involvement! 91%! BIM/VDC Users! ! Architect! General Contributor! 82%! Other Designers! 82%! 70%! Owner/Operator! 60%! Specialty Contractors! End-User! 49%! 43%! VDC Consultant! Regulatory Agency! 15%! CIFE, Stanford University © 2014! The least common project participants/stakeholders employed or involved in VDC activities were endusers, VDC consultants and regulatory agencies. ! Overall BIM/VDC Involvement! 91%! BIM/VDC Users! ! Architect! General Contributor! 82%! Other Designers! 82%! 70%! Owner/Operator! 60%! Specialty Contractors! End-User! 49%! 43%! VDC Consultant! Regulatory Agency! 15%! CIFE, Stanford University © 2014! Project participant/stakeholder involvement is increasing by year! 2012! 2013! 86%! Architect! 74%! BIM/VDC Users! ! General Contributor! 93%! 72%! Other Designers! Owner/Operator! 63%! Specialty Contractors! 63%! 93%! 100%! 93%! 43%! 49%! VDC Consultant! 64%! 35%! End-User! Regulatory Agency! 100%! 14%! 23%! CIFE, Stanford University © 2014! Owners, End-users and Specialty Contractors were involved in VDC related activities mostly after construction has commenced! Pre-construction! Construction and post-construction! 92%! 96%! Architect! 92%! 93%! BIM/VDC Users! ! General Contractor! 92%! 86%! Other Designers! 58%! Owner/Operator! 75%! 50%! End-User! 60%! 50%! 42%! VDC Consultant! 33%! Specialty Contractors! Regulatory Agency! 72%! 17%! 18%! CIFE, Stanford University © 2014! Projects delivered using Integrated Project Delivery have higher VDC scores ! Design-build! Design-Bid-Build! IPD! VDC Score ! 53%! 54%! BIM/VDC Users! ! 62%! 54%! 54%! Planning! 59%! 64%! 65%! Adoption! 74%! Technology! 51%! 55%! 55%! Performance! 48%! 47%! 60%! CIFE, Stanford University © 2014! ! ! BIM/VDC Key Performance Indicators! Discussion Points: Would IPD help? CIFE, Stanford University © 2014! Presentation Scope! What improves project performance and assist other BIM/VDC uses?! CIFE, Stanford University © 2014! 4 Key Performance Indicators can be extracted from the VDC Scorecard data! 1. Quantitative Objective Tracking:! !! ! ! !Frequency that quantitative objectives are being assessed and tracked! 2. 3D Elements:! BIM/VDC Key Performance Indicators! ! !Number of product elements modeled in 3D (using Uniformat II classifications)! 3. !Owner Involvement:! !! !Project owner’s involvement in BIM/VDC! 4. !Delivery method:! !! !Design-build / Design-build-bid / Integrated Project Delivery (IPD)! CIFE, Stanford University © 2014! On average, projects tracked more than once a year have higher overall and area scores in the VDC Scorecard ! Score Infrequent Tracking: ! once a year or less Frequent Tracking: ! more than once a year innovative 90% BIM/VDC Key Performance Indicators! ! ! best 75% advanced 50% 64% 48% 64% 48% typical 67% 65% 58% 58% 47% 43% 25% ! conventional! Overall VDC Score Planning! Adoption! Technology!Performance! CIFE, Stanford University © 2014! On average, projects tracked more than once a year have higher overall and area scores in the VDC Scorecard ! Score Infrequent Tracking: ! once a year or less Frequent Tracking: ! more than once a year innovative 90% BIM/VDC Key Performance Indicators! ! ! best 75% advanced 50% 64% 48% 64% 48% typical 67% 65% 58% 58% 47% 43% 25% ! conventional! Overall VDC Score Planning! Adoption! Technology!Performance! CIFE, Stanford University © 2014! Frequent quantitative objective tracking have significant correlations with six major uses of BIM/ VDC ! BIM/VDC Key Performance Indicators! ! ! 1) more applications using BIM! 2) !more information types incorporated or managed! 3) !more construction phases that use models! 4) !more product elements modeled in 3D! 5) !more contents included in: BIM or VDC guidelines, scope of work, or BIM Execution Plan ! 6) !more BIM/VDC -related qualitative objectives! CIFE, Stanford University © 2014! Frequent quantitative objective tracking have significant correlations with six major uses of BIM/ VDC! # of BIM Applications ! 18.22 Project management system interaction! Phase Covered by Model Use! 3.99 BIM/VDC Key Performance Indicators! ! ! 7.28 9.90 3.71 3.43 Infrequent Tracking Frequent Tracking Infrequent Tracking Frequent Tracking Infrequent Tracking Frequent Tracking CIFE, Stanford University © 2014! Frequent quantitative objective tracking have significant correlations with six major uses of BIM/ VDC! 3D-­‐modeled elements # of VDC-covered aspects! 12.39 ! ! 13.42 BIM/VDC Key Performance Indicators! Qualitative Objectives! 6.78 11.77 4.24 5.62 Infrequent Tracking Frequent Tracking Infrequent Tracking Frequent Tracking Infrequent Tracking Frequent Tracking CIFE, Stanford University © 2014! Projects with more than 13 product elements modeled in 3D (using Uniformat II classifications) have VDC scores ! Score Low Usage:! 13 or fewer 3D Elements High Usage:! more than 13 3D elements innovative 90% BIM/VDC Key Performance Indicators! ! ! best 75% advanced 53% 50% 41% 54% 43% 53% 62% 48% 49% 52% typical 30% 25% ! conventional! Overall VDC Score Planning! Adoption! Technology!Performance! CIFE, Stanford University © 2014! Projects with more than 13 product elements modeled in 3D (using Uniformat II classifications) have VDC scores ! Score Low Usage:! 13 or fewer 3D Elements High Usage:! more than 13 3D elements innovative 90% BIM/VDC Key Performance Indicators! ! ! best 75% advanced 53% 50% 41% 54% 43% 53% 62% 48% 49% 52% typical 30% 25% ! conventional! Overall VDC Score Planning! Adoption! Technology!Performance! CIFE, Stanford University © 2014! Higher usage of 3D product elements have significant correlations with 5 major uses of BIM/ VDC ! BIM/VDC Key Performance Indicators! ! ! 1) more applications using BIM! 2) !more information types incorporated or managed! 3) !more construction phases that use models! 4) !More quantitative objectives tracked !! 5) !more BIM/VDC -related qualitative objectives! CIFE, Stanford University © 2014! Higher usage of 3D product elements have significant correlations with 5 major uses of BIM/ VDC ! Phase Covered Project # of BIM Applications ! 18.57 management system interaction! 4.59 6.88 ! ! BIM/VDC Key Performance Indicators! by Model Use! 2.91 10.33 2.56 Low Usage High Usage Low Usage High Usage Low Usage High Usage CIFE, Stanford University © 2014! Higher usage of 3D product elements have significant correlations with 5 major uses of BIM/ VDC Qualitative ! Quant Obj Tracking! Objectives! 5.86 ! ! 3.25 BIM/VDC Key Performance Indicators! 2.50 Low Usage High Usage 4.00 Low Usage High Usage CIFE, Stanford University © 2014! When project owners participate, the projects have higher VDC scores ! Score Low Usage:! 13 or fewer 3D Elements High Usage:! more than 13 3D elements innovative 90% ! ! best 75% BIM/VDC Key Performance Indicators! 62% advanced 53% 54% 53% 50% 41% 43% typical 59% 55% 46% 48% 25% ! conventional! Overall VDC Score Planning! Adoption! Technology!Performance! CIFE, Stanford University © 2014! When project owners participate, the projects have higher VDC scores ! Score Low Usage:! 13 or fewer 3D Elements High Usage:! more than 13 3D elements innovative 90% ! ! best 75% BIM/VDC Key Performance Indicators! 62% advanced 53% 54% 53% 50% 41% 43% typical 59% 55% 46% 48% 25% ! conventional! Overall VDC Score Planning! Adoption! Technology!Performance! CIFE, Stanford University © 2014! Owner have significant correlations with 4 major uses of BIM/VDC ! BIM/VDC Key Performance Indicators! ! ! 1) more applications using BIM! 2) !more quantitative objectives! 3) !more contents included in: BIM or VDC guidelines, scope of work, or BIM Execution Plan !! 4) !more frequent tracking of quantitative objectives! CIFE, Stanford University © 2014! Owner have significant correlations with 4 major uses of BIM/VDC ! # of BIM Applications Quant Obj Assessment 2.85 BIM/VDC Key Performance Indicators! ! ! 13.48 6.82 Owner Not Involved 1.24 Owner Involved Owner Not Involved Owner Involved CIFE, Stanford University © 2014! Owner have significant correlations with 4 major uses of BIM/VDC ! # of VDC-covered aspects Quant Obj Tracking 8.15 BIM/VDC Key Performance Indicators! ! ! 2.65 3.50 Owner Not Involved 1.05 Owner Involved Owner Not Involved Owner Involved CIFE, Stanford University © 2014! Owner involvement also increases involvement of other project participants ! Project Participant/Stakeholder Involvement! 97%! ! ! BIM/VDC Key Performance Indicators! 81%! 80%! 76%! 39%! 32%! 26%! 0%! Other Designers! VDC Consultant! Specialty Contractors ! Regulartory Agency! CIFE, Stanford University © 2014! Owner involvement also pushes for more formalized VDC among project participants and stakeholders! Owner ! not involved Owner ! involved Low! Formalization BIM/VDC Key Performance Indicators! ! ! High! Formalization 1 2 3 4 5 6 Single company belief! Don’t know! Documented in 1 Innovative! company! Shared belief among companies! Documented & shared with multiple companies! CIFE, Stanford University © 2014! Projects delivered using Integrated Project Delivery have higher VDC scores ! Design-build! Design-Bid-Build! IPD! VDC Score ! 53%! 54%! BIM/VDC Users! ! 62%! 54%! 54%! Planning! 59%! 64%! 65%! Adoption! 74%! Technology! 51%! 55%! 55%! Performance! 48%! 47%! 60%! CIFE, Stanford University © 2014! BIM/VDC Key Performance Indicators! ! ! These four KPIs cover a wide range of BIM/VDC uses, and are significant indicators of how much and how well BIM/VDC is used ! CIFE, Stanford University © 2014! These four KPIs cover a wide range of BIM/VDC uses, and are significant indicators of how much and how well BIM/VDC is used ! BIM/VDC Key Performance Indicators! ! ! Overall and area scores CIFE, Stanford University © 2014! These four KPIs cover a wide range of BIM/VDC uses, and are significant indicators of how much and how well BIM/VDC is used ! Objective setting BIM/VDC Key Performance Indicators! ! ! Overall and area scores CIFE, Stanford University © 2014! These four KPIs cover a wide range of BIM/VDC uses, and are significant indicators of how much and how well BIM/VDC is used ! Objective setting BIM/VDC Key Performance Indicators! ! ! Overall and area scores Outcomes of the objectives CIFE, Stanford University © 2014! These four KPIs cover a wide range of BIM/VDC uses, and are significant indicators of how much and how well BIM/VDC is used ! Objective setting BIM/VDC Key Performance Indicators! ! ! Overall and area scores Specific uses of model applications Outcomes of the objectives CIFE, Stanford University © 2014! These four KPIs cover a wide range of BIM/VDC uses, and are significant indicators of how much and how well BIM/VDC is used ! Objective setting BIM/VDC Key Performance Indicators! ! ! Overall and area scores Coverage of BIM/VDC guides Specific uses of model applications Outcomes of the objectives CIFE, Stanford University © 2014! These four KPIs cover a wide range of BIM/VDC uses, and are significant indicators of how much and how well BIM/VDC is used ! BIM/VDC Key Performance Indicators! ! ! Overall and area scores Participant involvement Coverage of BIM/VDC guides Specific uses of model applications Objective setting Outcomes of the objectives CIFE, Stanford University © 2014!