1. Background

1.1 Short description

The objective is to provide a data subscription service to scientific users. The scientific user provides his data selection criteria. Regularly, a dataset of his selected data will be extracted from Research Infrastructures cloud and delivered in his personal cloud account.

1.2 Contact

1.3 Use case type

This use case is an implementation case
Euro-Argo, EMSO and ICOS Research Infrastructures will push a series of data and metadata on a so-called ENVRIPLUS cloud.
A data subscription service will be developed for scientific users.
Data provided for the cloud service:

• All Argo observations, daily updated
• Copernicus in situ observations
• A selection of EMSO observatories data
• ICOS-SOCAT carbon data observed from voluntary observation ships

1.4 Scientific domain and communities

Scientific domain

Atmosphere, hydrosphere, geosphere

Community

Data service provision, data usage.

Behavior

2. Detailed description

Objective and Impact

The objective is to provide a regular data flow to scientists, from different Reseach Infrastructures.

Challenges

• Provide data and metadata from complementary Research Infrastructure (Ocean, Atmosphere, space)
• Aggregate and distribute billions of observations
• Link between RI and E-infrastructures

Detailed scenario

The data subscription service to scientific users:

...

• Step 1 : Euro-Argo data file on the cloud (1to file daily updated)
• Step 2 : VM for indexation of data file (Elasticsearch)
• Step 3 : data file generation service (scoop Java API)
• Step 4 : data subscription/distribution service to OwnCloud accounts
• Step 5 : replicate data and VM in mirror sites (EU, US, AU, JP)
• Next steps : promote the development of various services around an ENVRIPLUS cloud

Technical status and requirements

This use case involves EGI and EUdat

Implementation plan and timetable

Timetable

• Step 1: 2016 Q1 Euro-Argo RI, EGI, EUDAT
• Step 2: 2016 Q2 Euro-Argo RI, EGI, EUDAT
• Step 3: 2016 Q3 Euro-Argo RI, EGI, EUDAT, EMSO RI, ECOS-SOCAT RI
• Step 4: 2016 Q4 Euro-Argo RI, EGI, EUDAT, EMSO RI, ECOS-SOCAT RI
• Step 5 : 2017 Euro-Argo RI, EGI, EUDAT, EMSO RI, ECOS-SOCAT RI

...

• Euro-Argo RI: 10 man months, 20 000€ (2 months of subcontracting)
• EGI
• EUDAR
• EMSO RI
• ECOS-SOCAT RI

Expected output and evaluation of output

In 2017, the first data subscribers and the number of downloaded files will be counted.
The experience will be a success if regular users receive the data files they need.

External Links:

1. TC_2 notebook: {+}https://envriplus.manageprojects.com/projects/wp9-service-validation-and-deployment-1/notebooks/630/pages/331+