Data Lakes

December 17th 2021, 14:00 - 17:00

In recent years, classic HPC users have seen an ever-increasing interest in the public cloud that is used as part of traditional HPC workflows. There are many reasons for this, e.g. special hardware components such as TPUs or special GPUs are available in the cloud earlier than in a local data center. In addition, there is a need for users to store any data for analysis using AI methods in different data silos and to be able to access them flexibly from HPC and cloud systems. A central role for data analytics workflows is the flexible data migration and provision in the data lake. For this purpose, highly-scalable object storage has long been established in the cloud area, which is mostly used via an S3 interface. Another advantage from the user's point of view for a consistent data management strategy as offered by a data lake is the uniform and consistent view that it allows for the individual data silos.

Data centers can share their plans and services regarding high-performance data analytics (HPDA) and big data analytics (BDA) and scientific data management. This workshop aims to foster interaction between data centers, administrators, and, most importantly, researchers.

Our motto is: Let's build a bridge to the data lake together

The videos of the event are now online on YouTube.


14:00 Welcome and Motivation Julian Kunkel (GWDG, Uni Göttingen)
Piotr Kasprzak (GWDG)
Slides Video
Short introductory round of all attendees
14:15 Use Case Presentation Mark Greiner (MPI CEC) Slides Video
14:45 Data Volume Considerations for NHR and NFDI Andreas Knüpfer (ZIH, TU Dresden) Slides Video
15:00 GWDG data lake services and future plans Julian Kunkel (GWDG, Uni Göttingen)
Piotr Kasprzak (GWDG)
Hendrik Nolte (GWDG)
15:30 Break and Networking
16:00 Data Lake not at any price - The DataLake concept must fit the requirements Alfred Schlaucher (Oracle) Slides Video
16:30 Discussion
17:00 Adjorn

Important Information

Date and Time Friday, December 17th 2021, 14:00 - 18:00
Venue Virtual
Organizers Julian Kunkel (Uni Göttingen/GWDG),
Hendrik Nolte (GWDG),
Alexander Goldmann (GWDG),


You can register for this workshop here. If you would like to give a talk, please contact Julian Kunkel.


This workshop is funded by the GWDG and supported by the NHR.

This website uses cookies. By using the website, you agree with storing cookies on your computer. Also you acknowledge that you have read and understand our Privacy Policy. If you do not agree leave the website.More information about cookies