Overview of the CNEP Air Monitoring
Program, our data management process, and
our involvement with the Exchange Network
National Tribal Forum on Air Quality
May 2015
• Cherokee Nation has
more than 317,000
citizens and 8,000
employees
• The Cherokee Nation
jurisdictional area is
comprised of 14 counties
in northeastern
Oklahoma
• Six full and eight partial
counties
• The jurisdiction is
approximately 7,000
square miles
Brief History of Cherokee Nation Clean Air Program
• The Clean Air Program began in 1996 with a §103 project grant
• The network consists of six monitoring stations – five fixed
locations and one mobile monitoring station
• These stations monitor criteria pollutants and a variety of other
pollutants, including mercury and ammonia.
• The Cherokee Nation participates in five EPA national program
initiatives: the Clean Air Status and Trends Network (CASTNET);
Interagency Monitoring of Protected Visual Environments
(IMPROVE); the Mercury Deposition Network (MDN); the
Ammonia Monitoring Network (AMoN); and the Atmospheric
Mercury Network (AMNet). The Cherokee Nation has also
established an NCore site at its rural CASTNet site near Stilwell.
The current monitoring location is with the Kickapoo Tribe in McLoud,
Oklahoma (start date March 20th, 2015)
Mobile parameters monitored include:
•
•
•
Ozone
PM10 & PM2.5 (TEOM 1405-D)
Met (Temperature, RH, WS & WD
What do we do with all of that data from our continuous air
monitors?
Data from all of our air monitoring sites is stored on two
data acquisition system (DAS) computers in our office.
CNEP uses two different types of data management
software: AirVision and Airodis.
AirVision
• Replaces E-DAS Ambient (although support is still
provided)
• Polls data from our ESC 8816 and ESC 8832 data loggers
• Used for Tahlequah, Stilwell, Newkirk, Roland and the
mobile station
http://agilairecorp.com/products/airvision/
Airodis
• Replaces Wincollect
• Polls data from our
WinAQMS dataloggers
(PC-based)
• Used for our NCore and
Pryor sites
http://www.airodis.com.au/
• Both systems use a SQL server database
• Both systems are used to generate daily
reports for overview and data files for
quarterly AQS upload
• Both systems poll sites hourly for upload
to AirNow
• Both systems generate AQCSV files for
AirNow
Data submittal requirements
• CNEP submits data hourly to AirNow
• CNEP submits data quarterly to AQS
• Data certification documentation submitted annually (due May 1st)
AirNow
The U.S. EPA, National Oceanic and Atmospheric Administration,
National Park Service, tribal, state, and local agencies developed the
AirNow system to provide the public with easy access to national air
quality information. AirNow receives real-time air quality
observations from over 2,000 monitoring stations and collects
forecasts for more than 300 cities.
AirNow data are used only to report the AQI, not to formulate or
support regulation, guidance or any other EPA decision or position.
This data sharing and centralization creates a one-stop source for
real-time and forecast air quality data.
http://www.airnow.gov/
This site is accessible to
the public; no password
is required.
The AQI translates air
quality data into numbers
and colors that help
people understand when
to take action to protect
their health.
The AQI is an index for reporting daily air quality. It is calculated for four major
air pollutants regulated by the CAA: ozone, particle pollution, carbon
monoxide, and sulfur dioxide.
AirNow-Tech & AirNow API:
Password-protected portals that
allow state & local agencies and
other researchers to submit and
track air quality data.
AirNow-Tech is where we submit
our hourly data files and manage
our site information.
AirNow-Tech is a password-protected website for air quality data
management analysis & decision support. AirNow-Tech is primarily used
by the federal, State, Tribal, and local air quality organizations that
provide data and forecasts to the AirNow system, as well as researchers
and other air data users.
It allows users to:
• Access monitoring site data, information, and polling status
• Analyze current and past air quality events and episodes
• Submit and analyze air quality forecasts
• Configure EnviroFlash email services for public dissemination of air
quality forecasts
• View meteorological and air quality data
• Generate data reports
• Create GIS-based maps
http://www.airnowtech.org/
AirNow-Tech uses the AQCSV file type, which uses the following
configuration:
site,data_status,,datetime,parameter,duration,,value,unit,qc,poc,,,,,,,,,
Hourly files from our Stilwell site for ozone look like this:
840400019009,0,,20150128T0000-0600,44201,60,,0.037,007,0,1,,,,,,,,,
840400019009,0,,20150128T0100-0600,44201,60,,0.037,007,0,1,,,,,,,,,
840400019009,0,,20150128T0200-0600,44201,60,,0.035,007,0,1,,,,,,,,,
840400019009,0,,20150128T0300-0600,44201,60,,0.032,007,0,1,,,,,,,,,
840400019009,0,,20150128T0400-0600,44201,60,,0.03,007,0,1,,,,,,,,,
840400019009,0,,20150128T0500-0600,44201,60,,0.03,007,0,1,,,,,,,,,
840400019009,0,,20150128T0600-0600,44201,60,,0.029,007,0,1,,,,,,,,,
840400019009,0,,20150128T0700-0600,44201,60,,0.029,007,0,1,,,,,,,,,
840400019009,0,,20150128T0800-0600,44201,60,,0.029,007,0,1,,,,,,,,,
840 – ISO country code for the United States
400019009 – Site ID for Stilwell; same ID as used for AQS
AirNow API
•
The AirNow API includes file outputs and
RSS data feeds
•
It produces data products in several
standard data formats and makes them
available via FTP and web services
•
Access to the AirNow API is generally
available to the public, but a password is
required
•
Web services offered include forecasts,
maps, and observations by monitoring
site or reporting area
•
Data feeds are grouped by state
http://www.airnowapi.org/
API?
Application Programming Interface
An API is a set of rules that allow one software
program or service to talk to another.
An API is a software-to-software interface, not a
user interface; generally invisible to end users.
What we do to verify data on a daily basis:
• Review daily report printouts (these are kept in our
office for two years before being moved off site for
storage)
• Dial in to sites to check connectivity and
instantaneous readings (some sites have Ethernet
connectivity)
• Record findings in our DAS log book
AQS data submission – performed quarterly
• Per grant requirements, data from the previous quarter
(e.g. January, February, March) must be entered before the
end of the next quarter (e.g. June 30th)
• Data is validated using daily reports and site logbook
information; data is edited if necessary within AirVision and
Airodis
• AQS reports are run to generate data in the proper format
(Pipe-delimited or XML files are both acceptable)
• Use QA Transaction Generator to create pipe-delimited files
for bi-weekly zero/span & precision checks, flow audits, etc.
• Both raw data and QA files are uploaded to AQS using the
Exchange Network Services Center or ENSC
AQS QA Transaction Generator
• Replaces the AQS P&A generator, which was a stand-alone Excel
workbook
• Tool to allow off-line creation of all QA transaction types
• Fields are validated as they are entered
• Has built-in capabilities to keep both software and AQS codes up-todate
• You don’t have to use the generator, but it is very convenient
The generator can be downloaded at:
http://www.epa.gov/ttn/airs/airsaqs/downloads.htm
•
All valid legacy P&A data has been converted to the corresponding QA data
•
Legacy precision (RP) and accuracy (RA) transactions no longer accepted after March 2015
RP & RA
transaction
types replaced
by these QA
transaction
types (much
more specific)
QA Redesign Overview
http://www.epa.gov/ttn/airs/airsaqs/training/
After raw data files and QA files are generated for
the quarter, data is loaded into the EPA Air
Quality System (AQS) via the Exchange Network
Services Center (ENSC).
ENSC – Exchange Network Services Center
If you use
the ENSC,
you are
using the
Exchange
Network.
More
about the
Exchange
Network
later…
The first step in any batch data submission to AQS takes place at the ENSC; the ENSC is the only
way to move data files from your organization to AQS.
You can either have your node or node client submit the file to AQS via the ENSC with
processing instructions or you can manually submit a file.
Annual data certification – due May 1st
Required:
• Formal statement attesting to ambient data completeness and accuracy
• AQS report(s): AMP600 data certification report and the AMP450NC Quick
Look summary report (if necessary) for non-criteria pollutants and 5-minute
SO2
Use AQS certification form to record the monitoring
agency request and any comments. This is also
where the region will add comments and designate
their certification flag.
AQS Certification Form
S=
submitted
Data storage/filing/backup
• Data backed up automatically on a remote server
• Data backed up every quarter on an external hard
drive
• Files kept for two years on site, then placed into
storage
What is the Exchange Network?
• The overarching goal of the Exchange Network is to improve decision
making by providing access to consistent and accurate environmental
data.
• The Exchange Network is a program that aims to share environmental,
health, geographic, and other types of data between tribes, states, and
territories through the Internet using common data standards.
• The Exchange Network is jointly governed by representatives from EPA,
states, and tribes.
“Sharing information for a cleaner environment”
http://www.exchangenetwork.net/
How the Exchange Network works:
How do I get started? Check out
http://www.exchangenetwork.net/getting-started-on-the-network/
•
•
•
•
for information about:
Joining the network
Nodes vs. Node clients
Network grants
Joining an exchange or designing a new exchange
Diagram copied from the Exchange Network web site.
Exchange Network Governance
• Exchange Network Leadership Council (ENLC) - The
primary leadership body of the Exchange Network, the
ENLC establishes policy and strategic direction and
charters Integrated Project Teams (IPTs).
• Network Technology Board (NTB) - A subgroup of the
ENLC, the NTB is the Network’s lead operational and
technical body. The NTB establishes and maintains
technical procedures, standards, and guidance and
provides technical support to the ENLC.
• The ENLC Co-Chairs, NTB Co-Chairs, and Exchange
Network Coordinator comprise the EN Coordination
Team; they manage day-to-day operations of the Network
and coordination of governance activities.
• Tribal Governance Group (TGG) - An ad hoc group of
Tribal professionals that work to support management
and communication of Tribes’ environmental data and
advocate for Tribal interests in the Exchange Network.
More about the Tribal Governance Group (TGG)
The Exchange Network Tribal Governance Group (TGG) was formed about 7 years ago with the
purpose of assessing Exchange Network (EN) policy, program developments, and initiatives, and to
share its views and recommendations regarding potential impacts to tribes and tribal programs.
The TGG advises EPA and EN Governance bodies to help ensure that EN policies and practices take
into consideration tribal sovereignty and the unique needs and constraints of tribes.
Our members represent tribes from Oklahoma, California and the State of Washington, as well as
the National Congress of American Indians (NCAI).
We are always looking for other tribes to participate!
http://www.tribalexchangenetwork.org/home.html
ITEP involvement with the Exchange Network & TGG
In 2014, ITEP began a cooperative agreement with EPA's Office of
Environmental Information (OEI) to provide tribal support for the EN. In this
capacity, ITEP works with the TGG and tribes, offering technical and
programmatic support on Exchange Network topics.
ITEP maintains the TGG website and coordinates the annual tribal EN
meeting.
Tribal Mentors Program: ITEP will work with the TGG and other Exchange
Network stakeholders to identify appropriate mentors, as well as tribes in
need of assistance. Where possible, a match will be made and ITEP will
facilitate logistics and outcomes for the project. Some travel funds to
support tribes may be available, as well as a contractual fee-for-service for
the mentoring tribe if requested.
Needs Assessment: Please take a moment to complete the assessment to
help us understand how we can better serve you and your participation in
the Exchange Network.
http://www.tribalexchangenetwork.org/home.html
How has CNEP been involved with the Exchange Network and TGG?
CNEP has received EN grants back to FY2002; projects have included the ITEC
STORET project, the building of the CNEP node, submitting open dump data as
part of the FRS data flow to CDX, and submitting air monitoring data through the
node and publishing data to a public web page (ongoing).
CNEP was asked to join the
TGG during the Tribal
Exchange Network Meeting in
May 2011; they were looking
for a member with air
monitoring experience.
Future plans using Exchange Network grant funds
• Build a website where tribal members can view our air monitoring site
information and access real-time data and AQI information
• Use data from our Tahlequah ozone monitor (which is located next to the
tribal complex) to display the current AQI on monitors in the complex
CNEP plans to begin submitting data through our node using the AirVision plug-in
• CNEP manages their node with OpenNode2 software
• The AQS AirVision plugin serves as an Exchange Network proxy
web service interface to the AirVision software
• These plugins are available free of cost at
http://www.exchangenetwork.net/exchange-network-products/
Diagram copied from the AQS v2.2a (AirVision) - Plugin Implementation Guide, prepared by Windsor Solutions.
The Exchange Network grant program and CNEP
Benefits:
•
Purchases – Able to buy some equipment that we could not acquire with our
air grant
•
Publishing – Will be able to share data obtained from our air monitoring
activities (and hopefully other CNEP programs as well)
Challenges:
•
IT turnover – Had to “start over” on a few projects
•
O&M – Not sure how equipment will be maintained over the long haul
Contact information:
April Hathcoat
april-hathcoat@cherokee.org
918-453-5098
http://www.itecmembers.org/
http://www.itecmembers.org/Programs/Overview-of-ITEC-Clean-Air-Program