dc.contributor.author | Signell, Richard P. | |
dc.contributor.author | Fernandes, Filipe | |
dc.contributor.author | Wilcox, Kyle | |
dc.date.accessioned | 2020-05-02T21:23:20Z | |
dc.date.available | 2020-05-02T21:23:20Z | |
dc.date.issued | 2016 | |
dc.identifier.citation | Signell, R.P.; Fernandes, F. and Wilcox, K. (2016) Dynamic Reusable Workflows for Ocean Science. Journal of Marine Science and Engineering, 4: 68, 12pp. DOI: https://doi.org/10.3390/jmse4040068 | en_US |
dc.identifier.uri | http://hdl.handle.net/11329/1321 | |
dc.identifier.uri | http://dx.doi.org/10.25607/OBP-829 | |
dc.description.abstract | Digital catalogs of ocean data have been available for decades, but advances in standardized
services and software for catalog searches and data access now make it possible to create
catalog-driven workflows that automate—end-to-end—data search, analysis, and visualization of
data from multiple distributed sources. Further, these workflows may be shared, reused, and adapted
with ease. Here we describe a workflow developed within the US Integrated Ocean Observing
System (IOOS) which automates the skill assessment of water temperature forecasts from multiple
ocean forecast models, allowing improved forecast products to be delivered for an open water swim
event. A series of Jupyter Notebooks are used to capture and document the end-to-end workflow
using a collection of Python tools that facilitate working with standardized catalog and data services.
The workflow first searches a catalog of metadata using the Open Geospatial Consortium (OGC)
Catalog Service for the Web (CSW), then accesses data service endpoints found in the metadata
records using the OGC Sensor Observation Service (SOS) for in situ sensor data and OPeNDAP
services for remotely-sensed and model data. Skill metrics are computed and time series comparisons
of forecast model and observed data are displayed interactively, leveraging the capabilities of modern
web browsers. The resulting workflow not only solves a challenging specific problem, but highlights
the benefits of dynamic, reusable workflows in general. These workflows adapt as new data enter the
data system, facilitate reproducible science, provide templates from which new scientific workflows
can be developed, and encourage data providers to use standardized services. As applied to the
ocean swim event, the workflow exposed problems with two of the ocean forecast products which led
to improved regional forecasts once errors were corrected. While the example is specific, the approach
is general, and we hope to see increased use of dynamic notebooks across geoscience domains. | en_US |
dc.language.iso | en | en_US |
dc.rights | Attribution 4.0 International | * |
dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | * |
dc.subject.other | Numerical modeling | en_US |
dc.subject.other | Reproducibility | en_US |
dc.subject.other | Catalog services | en_US |
dc.subject.other | Data services | en_US |
dc.subject.other | Web services | en_US |
dc.subject.other | Metadata | en_US |
dc.subject.other | Ocean forecasting | en_US |
dc.subject.other | Ocean modelling | en_US |
dc.subject.other | Data management | en_US |
dc.subject.other | Data system | en_US |
dc.subject.other | Interoperability | en_US |
dc.subject.other | OPeNDAP | en_US |
dc.subject.other | THREDDS | en_US |
dc.subject.other | CSW | en_US |
dc.subject.other | Jupyter Notebooks | en_US |
dc.title | Dynamic Reusable Workflows for Ocean Science. | en_US |
dc.type | Journal Contribution | en_US |
dc.description.refereed | Refereed | en_US |
dc.format.pagerange | 12pp. | en_US |
dc.identifier.doi | https://doi.org/10.3390/jmse4040068 | |
dc.subject.parameterDiscipline | Parameter Discipline::Physical oceanography::Other physical oceanographic measurements | en_US |
dc.subject.dmProcesses | Data Management Practices::Data processing | en_US |
dc.bibliographicCitation.title | Journal of Marine Science and Engineering | en_US |
dc.bibliographicCitation.volume | 4 | en_US |
dc.bibliographicCitation.issue | Article 68 | en_US |
dc.description.sdg | 14.A | en_US |
dc.description.maturitylevel | TRL 8 Actual system completed and "mission qualified" through test and demonstration in an operational environment (ground or space) | en_US |
dc.description.bptype | Manual (incl. handbook, guide, cookbook etc) | en_US |
obps.contact.contactemail | rsignell@usgs.gov | |
obps.resourceurl.publisher | https://www.mdpi.com/2077-1312/4/4/68 | en_US |