Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
en:services:application_services:high_performance_computing:workshops:data_lakes_workshop_nov_2021 [2021/12/06 11:46] – [Agenda] jkunkel1 | en:services:application_services:high_performance_computing:workshops:data_lakes_workshop_nov_2021 [2022/02/09 10:09] (current) – [Table] vend | ||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ====== Data Lakes ====== | ||
+ | **December 17th 2021, 14:00 - 17: | ||
+ | |||
+ | In recent years, classic HPC users have seen an ever-increasing interest in the public cloud that is used as part of traditional HPC workflows. There are many reasons for this, e.g. special hardware components such as TPUs or special GPUs are available in the cloud earlier than in a local data center. In addition, there is a need for users to store any data for analysis using AI methods in different data silos and to be able to access them flexibly from HPC and cloud systems. | ||
+ | {{ : | ||
+ | A central role for data analytics workflows is the flexible data migration and provision in the data lake. For this purpose, highly-scalable object storage has long been established in the cloud area, which is mostly used via an S3 interface. Another advantage from the user's point of view for a consistent data management strategy as offered by a data lake is the uniform and consistent view that it allows for the individual data silos. | ||
+ | |||
+ | Data centers can share their plans and services regarding high-performance data analytics (HPDA) and big data analytics (BDA) and scientific data management. This workshop aims to foster interaction between data centers, administrators, | ||
+ | |||
+ | Our motto is: **Let' | ||
+ | |||
+ | The videos of the event are now online on YouTube. | ||
+ | |||
+ | ===== Agenda ===== | ||
+ | |||
+ | | 14:00 | **Welcome and Motivation** | ||
+ | | | **Short introductory round of all attendees** | ||
+ | | 14:15 | **Use Case Presentation** | ||
+ | | 14:45 | **Data Volume Considerations for NHR and NFDI** | ||
+ | | 15:00 | **GWDG data lake services and future plans** | ||
+ | | 15:30 | //Break and Networking// | ||
+ | | 16:00 | **Data Lake not at any price - The DataLake concept must fit the requirements** | ||
+ | | 16:30 | Discussion | ||
+ | | 17:00 | **Adjorn** | ||
+ | |||
+ | ===== Important Information ===== | ||
+ | | Date and Time | Friday, December 17th 2021, 14:00 - 18:00 | | ||
+ | | Venue | Virtual | ||
+ | | Organizers | ||
+ | | | Hendrik Nolte (GWDG), hendrik.nolte@gwdg.de | ||
+ | | | Alexander Goldmann (GWDG), alexander.goldmann@gwdg.de | ||
+ | |||
+ | |||
+ | ==== Registration ==== | ||
+ | |||
+ | You can register for this workshop [[https:// | ||
+ | |||
+ | ==== Funding ==== | ||
+ | |||
+ | This workshop is funded by the GWDG and supported by the [[https:// | ||
+ | |||
+ | {{: |