USArray Data and Network Operations: Array Network Facility Overall Operations: Frank L. Vernon Luciana Astiz Metadata: Jennifer A. Eakins Systems: Brian Battistuz Davis, Geoff Foley, Steve Analists: rt: Martinov, Vladik & Karasu, Gulsum rev: Jon Tytell & Trilby Cox Web interface: Rob L. Newman & Juan Reyes August 25-29, 2010 NW University 1 Outline Overview of ANF operations & some fun tools with TA data Quick ANF website tour •Station information : web & reports • SoH Monitoring tools (dlmon & history) • Special Events • Event picks Examples of other Big Data Sets •1995: the IRIS 10th Anniversary Poster • 2002-2008: Baja data set - “a mi manera” Transportable Array Concept 400 broadband seismic stations • ~70 km spacing between stations • ~1500 x 800 km “footprint” • ~2 year deployments at each site, 1623 sites 2004 ANF • Operational Goals • High-quality broadband data • On par with permanent network stations • Maximize data return (>85%) • Data to the scientific and regional network community in near real time • 40 and 1 sps continuous • Equipment redeployed five times • “Adoptable” stations 2013 ANF Operations Operations at the Array Network Facility • Collection of TA station data & transfer to DMC • Provide station metadata to DMC (Dataless) • Monitor SoH channels & provide views to field engineers • Remote command & control of station equipment • Event location & association as data quality review • Instrumental Calibration • Recover & submit data gaps from station balers to DMC • Resubmit final station data upon removal to DMC TA Station Lifetime • Reconnaissance 1- 10 days • Permitting 1 - 500 days • Construction 0.2 - 2 day • Installation 0.2 - 1 day • Operation data transmission to ANF/DMC ~ 2 years but more for EARN stations monitoring of SoH by ANF servicing by field crews • Release removal of the station 1- 3 days or transfer of the station to a new operator Stations in the Field so far • On Schedule • 1030 commissioned Stations • 470 operating Stations • 525 removed Stations • Rolling eastward at a rate of about 400 km / year, 18 sta/mo • North-south deployment strategy permits year-round operations •Very Low power to avoid cultural noise sources and to maximize sitting opportunities. 3-5W solar powered. •Fast construction, material adapts to conditions, from ready sources. •high quality LP data requires thermal isolation. •High power communications separated from station power. Stations going in . . . •Local recording, minimum complexity in uplink . . . and coming out TA stations rolling East TA stations … Aug 2010 Decomissioned & Adopted Stations ‘ Status: RT Performance TA performance 2005 01 – 2010 07 ANF System Upgrades 2005 - Sun V240 2007 - Sun Cluster attempt (on 3 servers & Raid) -----did not work - Sun T2000 at SDSCC as backup (zfs) - Sun T2000 at DMC as 2nd backup (zfs) 2008 - Zones & zfs on 5 servers (Sun V240’s & T2000’s) - ANFwiki for internal documentation - backup acquisition system in SCC@ucsd 2009 - Added storage and 2- T5200 for processing & develop. - cvs for common software, mostly to Antelope-contrib - adding backup acquisition system at DMC 2010 - changed ANF internal documentation to Jira - Moving operational hardware to the SCC @UCSD - Backup systems: DMC and IGPP Data Flow at ANF Station Improvements Equipment Refinements for ++ data availability • Vault interface Enclosure • Protect equipment from humidity, increase reliability of comms equipment • Standardize connections • Cell modem replacements as networks upgrade • Baler44 (IP) phased into stations to replace Baler14 (Serial) • Add meteorlogical measurements ANF Operations Operations at the Array Network Facility • Collection of TA station data & transfer to DMC • Provide station metadata to DMC (Dataless) • Monitor SoH channels & provide views to field engineers • Remote command & control of station equipment • Event location & association as data quality review • Instrumental Calibration • Recover & submit data gaps from station balers to DMC • Resubmit final station data upon removal to DMC Data Return - TA 95%...!!!! 85% TA Gaps • Examined data gaps as a function of time • Examined cumulative gap statistics Status: RT Latency Data: Seismic, SoH, Logs •Real-time monitoring of SoH •Detect problems •Initiate corrective actions •Station QC & SoH on the web •SoH channel displays for near-real-time and summary •Metrics for arbitrary time intervals SoH for H09A Clock Quality • Examination of clock quality channels for test interval (2007) indicates clock quality is excellent Mass Position Sensor Mass Recenter operation affects data quality and broadly indicates the long-period quality of site. Most stations have 10 or fewer mass re-centers over a one year period Diagnostic View: Discovery! Guralp Vertical: mass position vs noise Power Density Functions • Noise PDF TA Vertical TA Horizontal GSN Vertical GSN Horizontal Sensors • Summary noise results aggregated by sensor type • Negligible differences between sensor types Data Flow at ANF Backups Backups Preferred Origin @ ANF ANF Bulletin Events @ H09A Events @ H17A Additional Assessments Calibration STS-2 CMG-3T Procedures: Calibration • Automated process for command, capture, and analysis of cal signals • Analysis of calibration signals to verify amplitude and phase response • Will apply to all TA stations at beginning and end of deployment • Network-wide calibration for sensor statistics Results from BRTT Antelope software Net Calibration Results Procedures: Orientation • Direct measurement of orientation of all stations • Using fiber-optic gyroscope IXSEA Octans IV, Nonmagnetic orientation accurate to < 0.2 degrees • Used at all new station installations • Used when existing TA stations are removed • Validation of empirical orientation determinations • Empirical estimates from surface and mantle wave polarization techniques TA station orientation, relative to north, from empirical analysis Results from Ekström and Busby, SRL, 2008 Orientations with P-waves Azimuthal Profiles Outline Overview of ANF operations & some fun tools with TA data Examples of other Big Data Sets •1995: the IRIS 10th Anniversary Poster Quick ANF website tour •Station information : web & reports • SoH Monitoring tools (dlmon & history) • Special Events • Event picks IRIS Poster-1995 100,000 1-hr long BH seismograms 3-compnent (Z, T, R) ~20 Gb ? Outline Overview of ANF operations & some fun tools with TA data Examples of other Big Data Sets •1995: the IRIS 10th Anniversary Poster • 2002-2008: Baja data set - “a mi manera” Quick ANF website tour •Station information : web & reports • SoH Monitoring tools (dlmon & history) • Special Events • Event picks ANF-homepage Station pages Baja datset:2002-2008 ~ 50 stations/year from 8 networks ~ 550 Gb of continous data