Hydroshare, JupyterHub, and strategies for collaborative and cloud based data sharing, modeling and analysis
David Gavin Tarboton, Anthony M. Castronova, Jonathan L. Goodall, Dandong Yin, Shaowen Wang, Martyn Clark, Christina Bandaragoda, Tanu Malik · HydroShare Resources · 2018
Advances in many domains of earth science increasingly require integration of information from multiple sources, reuse and repurposing of data, and collaboration. HydroShare is a web based hydrologic information system operated by the Consortium of Universities for the Advancement of Hydrologic Science Inc. (CUAHSI). HydroShare includes a repository for users to share and publish data and models in a variety of formats, and to make this information available in a citable, shareable, and discoverable manner. HydroShare also includes tools (web apps) that can act on content in HydroShare, providing users with a gateway to high performance computing and computing in the cloud. Jupyter notebooks, and associated code and data are an effective way to document and make a research analysis or modeling procedure reproducible. This presentation will describe how a Jupyter notebook in a HydroShare resource can be opened from a JupyterHub app using the HydroShare web app resource and API capabilities that enable linking a web app to HydroShare, reading of data from HydroShare and writing of results back to the HydroShare repository in a way that results can be shared among HydroShare users and groups to support research collaboration. This interoperability between HydroShare and other cyberinfrastructure elements serves as an example for how EarthCube cyberinfrastructure may integrate. Base functionality within JupyterHub supports data organization, simple scripting and visualization, while Docker containers are used to encapsulate models that have specific dependency requirements. This presentation will describe the strategy for, and challenges of using models in Docker containers, as well as using Geotrust software to package computational experiments as 'geounits', which are reproducible research objects that describe and package computational experiments. Presentation at EarthCube all hands meeting, June 6-8, 2018, Washington, DC https://www.earthcube.org/ECAHM2018