Crowdsourcing gas flux climatologies
and the big experiment
Jamie Shutler, Jean-Francois Piolle, Peter Land, David Woolf, Fanny Girard-Ardhuin,
Bertrand Chapron and Craig Donlon
Crowdsourcing ?
• Outsourcing a task (once performed by a small number of
people) to a large network.
• Tackling intractable and laborious problems, creating and
bringing together communities.
• Examples:
–
–
–
–
Crowdsourced travel reviews e.g. TripAdvisor.
Crowdsourced funding e.g. kickstarter.com, profounder.com
Crowdsourced humanitarian support e.g. tomnod.com, avaaz.org
Crowdsourced climate research. e.g. mapping the locations of the
world’s ~30,000 power plants to help validate global emission modelling
Crowdsourcing ?
• Outsourcing a task (once performed by a small number of
people) to a large network.
• Tackling intractable and laborious problems, creating and
bringing together communities.
• Examples:
–
–
–
–
Crowdsourced travel reviews e.g. TripAdvisor.
Crowdsourced funding e.g. kickstarter.com, profounder.com
Crowdsourced humanitarian support e.g. tomnod.com, avaaz.org
Crowdsourced climate research. e.g. mapping the locations of the
world’s ~30,000 power plants to help validate global emission models.
Crowdsource air-sea gas flux climatologies to investigate uncertainties
What we hope to gain
1. Insight into community parameterisation preferences.
1. Feedback on the Crowdsourcing platform (FluxEngine).
– Missing options
– Feedback on functionality
2. Guidance for future larger experiment
– Is it informative ?
– What should we concentrate on ?
– Which aspects or issues can we investigate ?
What we hope to gain
1. Insight into community parameterisation preferences.
1. Feedback on the Crowdsourcing platform (FluxEngine).
– Missing options
– Feedback on functionality
2. Guidance for future larger experiment
– Is it informative ?
– What should we concentrate on ?
– Which aspects or issues can we investigate ?
3. Participants for the larger experiment and co-authors for a journal paper
The platform - FluxEngine
Generic atmosphere-ocean gas flux data processing toolbox
The platform - FluxEngine
Generic atmosphere-ocean gas flux data processing toolbox
Installed on Nephalae cloud:
•
•
•
•
Free to use.
Ability to choose flux parameterisation and input data.
Large range of pre-processed input datasets in common spatial resolution and format.
Just need a web browser and an email address.
Nephelae
600 processing nodes.
1.5 Peta bytes of storage
Brochure describing the system
The platform - FluxEngine
Generic atmosphere-ocean gas flux data processing toolbox
Installed on Nephalae cloud:
•
•
•
•
Free to use.
Ability to choose flux parameterisation and input data.
Large range of pre-processed input datasets in common spatial resolution and format.
Just need a web browser and an email address.
Nephelae
600 processing nodes.
1.5 Peta bytes of storage
Brochure describing the system
The platform - FluxEngine
Extensively tested :
•
•
•
•
•
•
•
System and calculations verified using published data.
Successful use of IFREMER Cloud (Nephelae) data processing system.
500 TB of EO data available, 8 TB have been pre-processed.
Used extensively within project for uncertainty and rain investigations (>300 runs).
Being used within 2 UK projects and 2 ESA projects.
Configure and trigger processing of a climatology in just 5 minutes
link to output is emailed to you.
Example mean daily flux output
Example process indicator layer output using
ESA CCI chl-a
Shutler, J. D., Piolle, J-F., Land, P., Woolf, D. K., Goddijn-Murphy L.,, Paul, F., Girard-Ardhuin, F., Chapron, B., Donlon, C. J., (in-review) Flux Engine: A
flexible processing system for calculating air-sea carbon dioxide gas fluxes and climatologies, submitted to Journal of Atmospheric and Oceanic
Technology.
The platform - FluxEngine
Extensively tested :
•
•
•
•
•
•
•
System and calculations verified using published data.
Successful use of IFREMER Cloud (Nephelae) data processing system.
500 TB of EO data available, 8 TB have been pre-processed.
Used extensively within project for uncertainty and rain investigations (>300 runs).
Being used within 2 UK projects and 2 ESA projects.
Configure and trigger processing of a climatology in just 5 minutes
link to output is emailed to you.
Example mean daily flux output
Example process indicator layer output using
ESA CCI chl-a
Shutler, J. D., Piolle, J-F., Land, P., Woolf, D. K., Goddijn-Murphy L.,, Paul, F., Girard-Ardhuin, F., Chapron, B., Donlon, C. J., (in-review) Flux Engine: A
flexible processing system for calculating air-sea carbon dioxide gas fluxes and climatologies, submitted to Journal of Atmospheric and Oceanic
Technology.
The platform - FluxEngine
http://www.ifremer.fr/cersat1/exp/oceanflux
The platform - FluxEngine
http://www.ifremer.fr/cersat1/exp/oceanflux
The platform - FluxEngine
http://www.ifremer.fr/cersat1/exp/oceanflux
The big experiment
Default selections on most choices.
Please choose the:
1. Gas transfer velocity parameterisation
• Selection of standard wind parameterisations
• Define your own wind parameterisation
• Backscatter parameterisations
2. Fields of pCO2 or fCO2
• Takahashi et al., DSRII, (2009)
• Kriged SOCAT v1.5
• Kriged SOCAT v2.0
The big experiment
Experiment open from now until 13:00 on Thursday 30th October
Facilities:
– Wednesday 29th – building 14, Room P (meeting room with WiFi)
– Thursday 30th – building 1, training room (Computer suite)
– WiFi throughout venue – you can use your laptop at any time.
We will receive copies of all of your climatologies.
Friday 31st, just before lunch, we will present:
– Overview of crowd choices
– Net flux results (e.g. ensemble means, histogram of fluxes)
– Feedback
The big experiment - please take part!
Experiment open from now until 13:00 on Thursday (30th)
All you need is 5 minutes, a web browser and WiFi
Claim your free drink if you spot an error or find a bug!
http://www.ifremer.fr/cersat1/exp/oceanflux
username: oceanflux
password: _OCeanf1UX
Results will be presented just before lunch on Friday
Send feedback to : jams@pml.ac.uk
• Use twitter.
Basic climatology processing system
Daily data
[1] Compositing
and/or correction
(mean, median,
krigging, profile…)
Rain (intensity, event)
Wind (speed, direction)
SOCAT
SST (foundation, skin)
Ice (%age, thickness)
Wave (altimeter and WWIII model)
Salinity
Monthly data
SST fronts
Biology (ocean colour chl-a)
Takahashi climatology
Fixed data
Longhurst provinces
Bathymetry
Monthly
data
[2]
Climatology (monthly NetCDF)
Process indicator layers
- Variance (all data)
- Standard deviation (all data)
- Kurtosis (all data)
- no. of data points (all data)
- Kriging stats (SOCAT data only)
- Regions of low wind speed
- Dominance of wave breaking
- Diurnal warming (foundation – skin)
Flux calculation
- Default calculation (using
Takahashi climatology for pCO2
data ie. not using SOCAT data)
- Input data user configurable
- Formulation user configurable
- Ability to re-process
- Output format fixed
(contents/data-layers set by
configuration file)
Process indicator layers
- Biology type (low, medium, high)
- Presence of strong SST gradients
Data layers
- Monthly data (from daily data, e.g.
mean, median, krigging result)
- %age ice
- pCO2W
- pCO2A
- KWB, KWO, KW,trad, KWR, KW
- flux
- ΔpCO2
- asym, CI, CM
Process indicator layers
- Province
- Coastal or open-ocean