Menu
A+ A A-

Seminar: Performance Tuning of MPI Collectives - Status Quo and Open Problems

Event Details:

  • Date:          Tuesday, 29 November 2022
  • Time:         Starts: 16:00
  • Venue:       This is an online-only, public event. You may connect to our live stream of the discussion, available on Zoom (Password: VsSCz1)
  • Speaker:    Assoc. Prof. Sascha Hunold, Vienna University of Technology



CyI Logo RTI ver b     CaSToRC HPC

 

CaSToRC, the HPC National Competence Centre,
 invites you to the EuroCC and SimEA Seminar Series



 

Abstract

MPI collective operations such as MPI_Allreduce are fundamental basic blocks of large-scale applications in High Performance Computing. Since the MPI standard only defines the semantics of MPI communication operations, MPI implementations (e.g., Open MPI or MPICH) are free to implement the collective operations the best way possible. For important collective operations, e.g. MPI_Allreduce and MPI_Bcast, MPI libraries provide several algorithms for each operation.

In this talk, we investigate the problem of tuning MPI collective operations on a given supercomputer, i.e., selecting the best algorithm for a communication problem. For example, we would like to answer the following question: what is the fastest algorithm to execute an MPI_Bcast with 100 Bytes of data using 16 compute nodes and 32 processes per compute node. We also need to discuss the accuracy of methods that support the analysis of MPI applications, such as profiling or tracing. In addition, we show that basic methods from statistics and machine learning can help us to find efficient algorithms for collective operations in a practical setting.

 

About the Speaker

Sascha HunoldSascha Hunold is an associate professor at the TU Vienna, Austria. His research focuses on MPI, OpenMP, scheduling algorithms, and reproducibility in the context of parallel computing.

Sascha Hunold received his Ph.D. degree in Computer Science from the University of Bayreuth, Germany, and his M.Sc. degree in Computer Science from the University of Halle-Wittenberg, Germany.  Afterwards, he held postdoctoral positions in Berkeley, Grenoble, and Heidelberg.

 

 


 

Download the Fall 2022 EuroCC & SimEA Seminar Series Programme here.

Screenshot 2022 04 12 165256 


 

The EuroCC project has received funding from the European Union’s Horizon 2020 research and innovation programme grant agreement No. 951732

European Union's Horizon 2020 Research and Innovation Programme

The SimEA project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 810660

 


 

The seminar will be in English and the event is open to the public.
This is an online-only, public event. You may connect to our live stream of the discussion, available on Zoom (Password: VsSCz1).
Images and/or recordings of our open public events may be used by The Cyprus Institute for dissemination purposes including print and digital media such as websites, press-releases, social media, and live streaming.

 



Contact 
This email address is being protected from spambots. You need JavaScript enabled to view it.

View all CyI events.

 

Additional Info

  • Date: Tuesday, 29 November 2022
  • Time: Starts: 16:00
  • Speaker: Assoc. Prof. Sascha Hunold, Vienna University of Technology