lsteffenel/hpc-python

Python in High Performance Computing

Python in High Performance Computing

This binder image includes several exercices from the CSC course "Python in High Performance Computing". The course is part of PRACE Training activity at CSC (https://www.futurelearn.com/courses/python-in-hpc).

Also, it includes material from a Dask tutorial given at SciPy 2020 conference.

NOTE : Exercices with "-->" are suggestions to start

Exercises

Basic array manipulation

• Reference vs. copy
• Array creation
• Array slicing
• Split and combine arrays
• Subdiagonal matrix

NumPy tools

• Input and output
• Polynomials
• Random numbers
• Linear algebra

Advanced NumPy

• Advanced indexing
• Mutating DNA sequence
• Translation with broadcasting
• Finite-difference
• Numerical integration
• Temporary arrays
• Numexpr

Performance analysis

• --> Using cProfile

Multiprocessing

• Simple calculation
• Work distribution

Parallel programming with mpi4py

• --> Hello World
• Simple message exchange
• Message chain
• --> Non-blocking communication
• --> Collective operations

Dask

• --> Delayed
• Understanding 'Lazy'
• Bags
• Arrays
• --> Dataframe
• --> Distributed mode
• Distributed advanced
• Storage optimization
• Machine Learning

Bonus exercises

• Game of life
• Rotation with broadcasting
• Two dimensional heat equation
• Parallel heat equation