Concurrent and parallel programming might seem complex, but this guide simplifies it. Learn about sequential vs non-sequential programming, processes, and threads. Explore examples in popular languages like C++, Python, and JavaScript to apply your new knowledge to your projects.
| No. | Description | Markdown |
|---|---|---|
| 1 | Basic terminology for parallel and concurrent programming concepts |  |
| 2 | Covers the basics of multithreading, including how to create and manage threads, synchronization, and thread safety. | |
| 3 | Introduces multiprocessing and covers the creation and management of processes, inter-process communication, and synchronization. | |
| 4 | Covers the basics of asynchronous programming, including async/await syntax and asyncio library in Python. | |
| 5 | Introduces Message Passing Interface (MPI), a standard for message-passing used in parallel computing. Covers its architecture, implementation, and basic concepts. | |
| 6 | Covers the hardware components and architectures used in parallel computing, including shared-memory and distributed-memory systems, clusters, and GPUs. | |
- https://www.personal.kent.edu/~rmuhamma/OpSystems/os.html
- https://www.oreilly.com/library/view/the-art-of/9780596802424/
- https://pybay.com/site_media/slides/raymond2017-keynote/index.html
- https://courses.cs.cornell.edu/cs100/1999su/lectures/lecture17/sld003.htm
- https://inst.eecs.berkeley.edu/~cs152/fa16/lectures/
- https://princetonuniversity.github.io/PUbootcamp/sessions/parallel-programming/
- https://w3.cs.jmu.edu/kirkpams/OpenCSF/Books/csf/html/
- https://lucumr.pocoo.org/2016/10/30/i-dont-understand-asyncio/
- https://www.cs.unb.ca/~bremner/teaching/cs2613/books/nodejs-api/
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.