Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
en:services:application_services:high_performance_computing:software:spark [2023/06/03 09:42] – [Creating a Spark Cluster on the SCC] venden:services:application_services:high_performance_computing:software:spark [2024/05/31 11:18] (current) – add MODULEPATH extension ckoehle2
Line 15: Line 15:
  
 <code> <code>
 +gwdu102 ~ > export MODULEPATH=/opt/sw/modules/21.12/scc/common:$MODULEPATH
 gwdu102 ~ > module load spark/3.4.0 gwdu102 ~ > module load spark/3.4.0
 </code> </code>
Line 98: Line 99:
 You can find a more in-depth tour on the Spark architecture, features and examples (based on Scala) in the [[https://info.gwdg.de/wiki/doku.php?id=wiki:hpc:parallel_processing_with_spark_on_gwdg_s_scientific_compute_cluster|HPC wiki]]. You can find a more in-depth tour on the Spark architecture, features and examples (based on Scala) in the [[https://info.gwdg.de/wiki/doku.php?id=wiki:hpc:parallel_processing_with_spark_on_gwdg_s_scientific_compute_cluster|HPC wiki]].
  
- --- //[[christian.koehler@gwdg.de|ckoehle2]] 2023/05/15 17:47//+ --- //[[christian.koehler@gwdg.de|ckoehle2]] 2024/05/31 11:17//