Hybrid Cloud storage deployment models: ARCHIVER presentation at the CS3 Workshop, January 2020

Hybrid Cloud storage deployment models

João Fernandes1 ; Bob Jones1 ; Marion Devouassoux2

1. CERN
2. Polytech Lille (FR)

Currently, many research projects struggle to manage their data, as the archiving and preservation services are inadequate and fall below expectations while data stewardship costs are frequently underestimated during the planning phase. Using the EC Pre-Commercial Procurement instrument, the ARCHIVER project goal is to fulfil these data management promises in a multi-disciplinary environment, allowing each research group to retain ownership of their data whilst leveraging best practices, standards and economies of scale.

ARCHIVER will combine multiple ICT technologies, including extreme data-scaling, network connectivity, service interoperability and business models, in a hybrid cloud environment to deliver end- to-end archival and preservation services that cover the full research lifecycle. The use-cases driving the consortium’s need for research and development of innovative data preservation services will extend the preservation ecosystems of the procurers to create more dynamic solutions using a hybrid model allowing to combine in some cases on-premise capacity with external services operated by commercial suppliers or, alternatively extending existing scientific preservation software to additional sciences domains and workflows integrated with capacity supplied by commercial cloud services in order to ensure service long-term sustainability. In both cases, the approach will be enhanced to comply with the OAIS reference model and the relevant series of standards (ISO 14721).

Commercial service providers are being considered by the European research community as part of a hybrid cloud model to support the needs of their scientific programmes. However, research institutions and end user researchers struggle to incorporate these commercial services into their activities in a structured manner. Service discovery and procurement are difficult and take up an inordinate amount of time. Service providers find it difficult to reach and meet the needs of the research community in areas such as legal, financial and technical compliance. The Open Clouds for Research Environments (OCRE) consortium aims to change this: to bridge this gap between the supply and demand sides and enable and facilitate researchers to use these cloud services in a safe and easy manner, in order to make it part of their day-to-day scientific activity.

Event page: https://cs3.deic.dk/

Presentation: