c-scale-icon-combined-federated-compute-resources-nt

FedEarthData: Federated Earth System Simulation and Data Processing Platform

The Federated Earth System Simulation and Data Processing Platform provides a distributed infrastructure of data and compute providers to support the execution of Earth System Simulation and Data Processing workflows at scale.

It offers a flexible cloud-based data processing capacity to create and scale data processing pipelines that run on optimised execution environments near the data. Jupyter Notebooks and openEO API offer user friendly and intuitive processing of a wide variety of Earth Observation datasets on these computing providers, including the ability to integrate these data with modelling and forecasting workflows leveraging specialised compute resources.

Providers of the Copernicus Data Processing Platform already count with an extensive collection of Copernicus datasets, managed according to the FAIR principles, and may be further extended with new datasets requested by users of the platform.

Who can apply?

The FedEarthData service targets international students and researchers, research organisations, projects, communities and groups, as well as businesses and innovators who are interested in executing their Copernicus and/or Earth Observation data processing and analysis workflows.

What’s in it for you?

The FedEarthData service targets international students and researchers, research organisations, projects, communities and groups, as well as businesses and innovators who are interested in executing their Copernicus and/or Earth Observation data processing and analysis workflows.

What’s in it for you?

FedEarthData offers brokering for access to compute and storage resources hosting Copernicus data and compute platform services supporting Earth Observation data analytics, data management services and related documentation and training material. FedEarthData service enables you to:

• Discover, access and catalogue a large repository of Copernicus data collections.

– Explore our EO-MQS service for discovering data across the C-SCALE data federation.

• Create and execute Copernicus and/or Earth Observation data processing workflows on the C-SCALE distributed computing infrastructure.

– Easily access European Cloud IaaS and reduce your reliance on proprietary cloud platforms.

– Run large parallel workloads on HPC/HTC platforms.

– Manage complex workloads, train AI models, deploy automated clusters and run containerised applications.

• Engage with other users and experts in the C-SCALE user community, and access support material for the development of scalable cloud agnostic and interoperable solutions.

– Visit our C-SCALE Wiki page and.

– Check out our C-SCALE YouTube channel.

• Develop collaboration with European research infrastructures and EOSC stakeholders.

The FedEarthData offering

• Federation of Copernicus data archives: Sentinel-1, -2, -3 and -5 archives, PROBA-V and other Copernicus products.

• Federation of OpenStack-based Infrastructure-as-a-Service cloud providers to deploy and scale virtual machines on-demand.

– User access control enabled with EOSC AAI compatible solutions

– High level orchestration of heterogeneous Cloud resources enabled with the INDIGO-DC PaaS Orchestrator.

• Federation of SLURM-based High-Throughput Compute (HTC) and High-Performance Compute (HPC) providers

– User access control enabled with EOSC AAI compatible solutions

• Storage coupled with Cloud and HTC/HPC resources to support workflow development and execution as well as to store intermediate and end data products.

• Jupyter Notebooks for interactive analysis

• A portfolio of Workflow Solutions that can be used and customised on the infrastructure resources.

How to request access to the FedEarthData Service?

Applicants are requested to provide the following information:

• Project representative and optionally additional contact person

• Description of the activities that are planned to perform using the FedEarthData service

• Infrastructure requirements (i.e., number of CPUs, amount of RAM, amount of storage resources)

• Data requirements – if you need support from C-SCALE to provision data for your activities and workflows, please have a look at what’s already available in the Earth Observation – Metadata Query Service. If the data of interest is not available in the EO-MQS, please share with us a URL pointing to an official Copernicus data product that you would like to have ready to run your workload. We cannot guarantee the provisioning of the data, but we will do our best to provide it.

• Software requirements

Orders can be submitted by filling in and sending the application form (linked in the Access button above) by e-mail (to contact@c-scale.eu).

Acceptance Procedure

Orders submitted to access the FedEarthData service are shared with the C-SCALE service providers to gauge interest. The applicants will be contacted within one month, with interested service providers indicating: the specific access conditions and individual agreement to be signed.

For further questions, please do not hesitate to contact us at contact@c-scale.eu.