Onboard/In-Field
Automated Fault Detection and Diagnostics
a Subcommittee of the Advanced Technology Committee
of the Western HVAC Performance Alliance
Subcommittee Meeting
9:30am – 12:30pm (PT) December 11, 2012
Call-in: 712/432-0075 742911#
Weblink: http://uc-d.na4.acrobat.com/wcec/
Agenda
• 9:30
• 10:00
• 10:30
• 11:30
• 12:30
Recap of 2012, Results of Roadmap
Prioritization Survey
Presentation of Climacheck Case Study
Presentation of Ezenics and Enterprise
Plug n Play Diagnostics and
Optimization for Smart Buildings
HVAC Maintenance Behavior: the
Customer and the Technician
Adjourn
2012 AFDD Subcommittee Accomplishments
•
•
•
•
•
•
Roadmap Reviewed and Survey Conducted
Title 24 Requirement Passed
SCE continued Testing
SPC 207 Launched
Developed Timeline of AFDD Advancements
Presentations
–
–
–
–
–
Daihung Yu: Virtual Sensors
Jon Douglas: Residential and Light Commercial Systems
Sean McCaffrey: Case Study
Brian Thompson: Ezenics
Kristin Heinemeier and Claudia Barriga: Maintenance Behavior
Results of Roadmap Prioritization: Onboard
Lack of Availability
Research into Residential FDD
Research into FDD on Thermostat
Research into Non-Microprocessor Units
Research FDD for Different System Types
Other (please specify)
1
3
3
6
3
The link between the onboard FDD results and systems or
people to act upon it not just getting more overwhelmed.
Research into successful applications and case studies
reliable economizer FDD
Results of Roadmap Prioritization: Onboard
Lack of Standards
Collaboration with CEE
Energy Star "Most Efficient" Criteria
2013 T24 Standard
ASHRAE Standard method of Test for RTU FDD
Research Laboratory Methods of Test
Inventory Reach Codes
Propose Reach Code FDD Requirements
Propose ASHRAE Std. 90.1 FDD Requirements
Propose ASHRAE Std. 189.1 FDD Requirements
2016 T24 Standard
Other (please specify)
0
1
2
3
3
0
3
2
1
1
0
Results of Roadmap Prioritization: Onboard
Lack of Customer Pull
Research into Maintenance Behavior
High Performance RTU Challenge
Research into Fault Incidence
1
1
3
Cost Effectiveness Assessment and Dissemination
3
Program Pilot Test
Case Studies
Research into Market Acceptability
Design IOU FDD Program
Launch IOU FDD Program
Other (please specify)
Integrate IOU FDD program into existing CQM prgms
0
2
1
2
2
1
Results of Roadmap Prioritization: InField
Lack of Validated Protocols
Results from Diagnostic Protocol Evaluator Project
7
Collect and Disseminate Field Data
2
Benchmark and Assess Existing Protocols
6
Create Gap Analysis of Existing Protocols
1
Other (please specify)
2
Options to quickly deal with and meet security & IT needs
Answer 1 seems to be part of Answer 3
Evaluating Diagnostic Protocols
• PIER-Purdue Protocol Evaluator: accuracy test for FDD
protocols
– refrigerant charge
– evaporator & condenser airflow
– non-condensables
– liquid line restrictions
– compressor valve leakage
Application software/users manual in final development
•
CA T24 2008/2013 Installer/HERS RCA spec
“…performs poorly. Flagging faults in up to 46% of the unfaulted
cases, misdiagnosing over 25% of cases with faults, and not
detecting faults in 32-55% of the cases with faults present.”
FDD Evaluator Review
• Draft Diagnostic Protocol Evaluator report:
January 2013
www.newbuildings.org
www.performancealliance.org
http://wcec.ucdavis.edu/
• Tentative March 1, 2013 in-person meeting
@ WCEC UC/Davis
– Review evaluator
– Review RCA issues
Results of Roadmap Prioritization: InField
Lack of Customer Pull
Develop Program for Commercial Buildings
12
Develop Program for Residential Buildings
1
Conduct Human Behavior Projects
3
Other (please specify)
0
Results of Roadmap Prioritization: InField
Lack of Integration with Existing Systems
Answer Options
Work with Manufacturers to Enhance Maintainability
Institute Voluntary Industry Agreement to Deliver
Changes
In-Field FDD and Maintenance Study
Work with OEMS to Develop Products
Other (please specify)
Response
Count
2
2
7
3
2
Promote "FDD READY" tag for everything from work order
software, to control hardware, to energy rate supply
solutions
Work with OEMs to reach consenus around use of portable
computerized FDD
OnBoard Priorities
• Research FDD for Different System Types
• Laboratory Methods of Test
•
•
•
•
•
Research into FDD on Thermostat
Research into Non-Microprocessor Units
Propose Reach Code FDD Requirements
Research into Fault Incidence
Cost Effectiveness Assessment and Dissemination
InField Priorities
• Results from Diagnostic Protocol Evaluator
Project
• Benchmark and Assess Existing Protocols
• Develop Program for Commercial Buildings
• In-Field FDD and Maintenance Study
• Conduct Human Behavior Projects
• Work with OEMS to Develop Products
FDD Case Study Presentation
• ClimaCheck
» Sean McCaffrey
Manufacturer Presentation
• Ezenics
• Enterprise Plug n Play Diagnostics and
Optimization for Smart Buildings
» Brian Thompson
Research Presentation
• Understanding Maintenance Behavior
» Customer: Claudia Barriga
» Technician: Kristin Heinemeier
Maintenance and Real People
Kristin Heinemeier
kheinemeier@ucdavis.edu
Claudia Barriga
cabarriga@ucdavis.edu
HVAC Behavioral Research Initiative
HVAC BEHAVIORAL RESEARCH INITIATIVE
2011-2012 PROJECTS
• “Understanding Maintenance Behavior in Residential
and Light Commercial End Users.” (SCE HTSDA)
• “Lab and Field Usability of In-Home Energy Displays”
(SCE HTSDA)
• “Behavior and AFDD” (SCE HTSDA – Q4 ‘12)
• “Understanding Contractor and Technician Behavior”
(SCE EM&V)
• “Roadmap for Behavior and Human Factors Research in
HVAC” (CEC/PIER IA)
• “HVAC Technician Instrument Laboratory” (CEC/PIER
CIEE)
Understanding Maintenance Behavior in
Residential and Light Commercial End Users
Claudia Barriga, Kristin Heinemeier, Laura Flynn,
Dina Biscotti
Western Cooling Efficiency Center
Energy Efficiency Center
Southern California Edison
Methods
Survey of Residential End Users
• Sample
– 270 Southern California Residents
– Random Sample from SCE territory
• Online Survey Residents
–
–
–
–
Knowledge about AC and maintenance
Attitudes towards AC and maintenance
Attitudes towards the environment
Preferences for FDD alert systems
Characteristics of Sample Regarding AC Maintenance
Regularly maintains Air Conditioner
Has had (ever) the AC professionally serviced
Has had professional service within the last
year
Has been offered an HVAC maintenance
agreement
Currently has an HVAC maintenance
agreement
143 (53%)
193 (71.5%)
97(35.9%)
140 (51.9%)
33 (12.2%)
HOW
WOULD YOU KNOW THAT YOUR
REPAIRS OR MAINTENANCE?
AC
NEEDS
RESPONSE CATEGORIES
RESPONSES (N
= 270)
Not Cooling
192 (71.1%)
Not turning on (Fan, Blower, Motor)
109 (40.4%)
Makes atypical noises
96 (35.6%)
Unusual Smells
20 (7.4%)
High Energy Bills/System running constantly
23 (8.5%)
Alert (Light in Thermostat)
18 (6.7%)
Scheduled Professional Maintenance
11 (4.1%)
Preferred FDD Alert Type
FDD ALERT TYPE
Light alerting fault + specific fault
information
(N = 270)
Flashing light indicating fault
117 (43.3%)
Beeping sound indicating fault
100 (37.0%)
Green light indicating proper operation
Numerical rating of AC performance (e.g.
at 75%)
100 (37.0%)
Light alerting fault + risk information
Light alerting fault + optimization
opportunities info
Light alerting fault + automatic message
to HVAC technical service
81 (30.0%)
153 (56.7%)
86 (31.9%)
72 (26.7%)
43 (15.9%)
Simulated In Home Energy Displays with Specific vs. General
Alerts and Recommendations
Semantic Differential Rating for Refrigerator, Car and Air Conditioners
7
Refrigerator
Air Conditioner
6
5
4
3
2
1
)
Car
Air Conditioners are...
7
6.5
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
I think this should be vertical and tagged at both ends, with color coding for bad
stuff (red bad, green good)
7
6.5
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
Perceived Importance of Maintenance Contractor Characteristics (N = 258)
Methods
Focus Groups of Small Business Owners
• Four Focus Groups in 2 SCE territory locations
• 10-12 participants per group
• Attitudes towards AC and maintenance
• Attitudes towards Utilities Energy Efficiency
Programs
• Attitudes towards the Environment
Key Findings
•
KEY FINDING 1: SMALL BUSINESS OWNERS ARE NOT CONVINCED THAT REGULAR HVAC
MAINTENANCE SAVES MONEY.
•
Recommendations: Show customers approximate (or best yet, actual) energy
savings on bill that result from active participation in maintenance programs.
Develop tools or techniques to field test AC unit efficiency before and after
measures are implemented.
•
KEY FINDING 2: SMALL BUSINESS OWNERS DO NOT UNDERSTAND HOW TO PROPERLY MAINTAIN
HVAC EQUIPMENT.
•
Recommendation: Create a guide for small businesses owners to use as a
screening tool to find good contractors and as a double check for existing
contractors.
•
KEY FINDING 3: SMALL BUSINESS OWNERS DO NOT LIKE COMPLICATED REBATE PROGRAMS.
•
Recommendation: Streamline rebate process or encourage contractors to take on
the role of rebate collectors to minimize inconvenience to small business owners.
Another idea is to provide the rebate as a credit on the utility bill.
Maintenance Technician Observation
Study
• Covertly Observed 13
Maintenance Technicians
• Requested “service,”
“maintenance,” and “energy
tune-up”.
• Two “faults”:
• Airflow <250cfm/ton
• Registers closed
• Post-Observation Interview
Technician
Characteristics
Tech #
Invite Years of Service Service
Type
Exp. Duration Price
Certified
Prog.
Part.
21
1
7
1:02
$
75
31
1
20
0:50
$
69
43
1
17
2:02
$
75 NATE,NCI
54
1
7
0:40
$
79
80
1
16
1:00
$
89
96
2
22
0:23
$
60
33
2
14
1:30
$
79
72
2
26
1:35
$
85
87
3
12
0:57
$
75
99
3
14
1:16
$
179
22
3
30
0:42
$
80
65
4
1
1:33
$
180
✔
79
4
13
2:00
$
149 NATE,NCI
✔
Nat'l
Chain
✔
Owner
✔
✔
NATE
✔
✔
✔
NATE
✔
Technicians
Task Description
Thermostat
Registers
Air Filter
Temp Split
Furnace
Electrical
Line and Duct
Insulation
Ext. Static
Airflow
Ducts
Condenser Coil
Motor Amps
Biologicals
Refrig. Chg.
Evaporator Coil
Total Attempts
Total Correct
43
79
● ●
●
○ ○
● ●
●
●
○
● ○
● ○
○ ○
72
65
●
99
87
●
80
21
96
31
33
22
Number of
Number of
Techs.
54 Attempt Techs. Correct
○ ●
○
●
●
● ●
● ○ ○
○ ○
○
○
○
○
○
○ ○ ○ ○
○
○
○ ○
○ ○
○
○ ● ○
○ ○ ○
○ ● ○
○ ○ ○
○ ○ ○
○
○ ○
○ ○ ○ ○
○ ○
○
○
○
○ ○
○ ○ ○
○
○
○ ○
○ ○
○ ○
○
10
10
8
8
10
8
7
6
6
2
6
6
0
6
3
2
2
1
1
1
1
1
1
0
0
0
6
5
5
4
9
2
6
2
5
2
9
1
9
1
2
1
2
1
9
0
7
0
7
0
6
0
5
0
0
0
Tasks Completed Correctly by Service
Duration and Technician Characteristics
Recommendations by Technicians
Technician
21
31
43
54
80
96
33
72
87
99
22
65
79
Average
Cost
$650
$150
$129
$1,236
$1,194
$445
$156
$566
Recommendation
New supply ducts
New supply ducts and UV light
New capacitor for condenser and fan
Add up to 3 pounds of refrigerant
N/A
N/A
Hard-start and run capacitors, UV bulb, Schrader core
replacement
UV lamp, blower fan, contactor, air filter for two systems
New condenser fan motor
N/A
Add 1 pound of refrigerant
Replace contactor
Improve airflow and add refrigerant charge
Technician Observation Conclusions
• Technical performance was below the
standards of ACCA 4 and “Quality
Maintenance” goals.
• Yet, technicians were more knowledgeable
than their technical performance scores would
suggest
• This study does not provide evidence that lack
of training or certification is creating the
problem.
Technician Observation Conclusions
• Technicians work hard to achieve their
perceived company and customer goals:
• Company Goals
• Their company’s goal is to sell and accomplish as many
service calls as possible in one day.
• Customer Goals
• Customers are interested in only two things: in the
equipment working when needed, and in spending as
little time and money as possible to achieve that goal.
Technician Observation Conclusions
• These goals are closely tied both to the
industry’s traditional practices around
“maintenance services” and to common
connotations of the word “maintenance”.
• Industry transformation should include a way
to make technicians see the non-traditional
goals of quality technical performance as
consistent with the goals of their employers
and their customers.
Technician Observation Conclusions
• A new category of service other than
“maintenance” or “tune-up”, is
required…perhaps “optimization”.
• Solid data on benefits, both for the industry at
large and for individual buildings, is key.
•Discussion…
Thank you!
43
• Mark Cherniack
markc@newbuildings.org
• Kristin Heinemeier
kheinemeier@ucdavis.edu
• Jerine Ahmed
jerine.ahmed@sce.com
• Anthony Hernandez
anthony.hernandez@sce.com
• KC Spivey
kcs7@pge.com