gavin1332/edl

Elastic Deep Learning using PaddlePaddle and Kubernetes

EDL: Elastic Deep Learning

EDL is an Elastic Deep Learning framework designed to help deep learning cloud service providers to build cluster cloud services using deep learning frameworks such as PaddlePaddle and TensorFlow. EDL includes a Kubernetes controller, PaddlePaddle auto-scaler, which changes the number of processes of distributed jobs to the idle hardware resource in the cluster, and a new fault-tolerable architecture.

EDL is an incubation-stage project of the LF AI Foundation.

While many hardware and software manufacturers are working on improving the running time of deep learning jobs, EDL optimizes

1. the global utilization of the cluster, and
2. the waiting time of job submitters.

For more about the project EDL, please refer to this invited blog post on the Kubernetes official blog.

EDL includes two parts:

1. a Kubernetes controller for the elastic scheduling of distributed deep learning jobs, and

2. making PaddlePaddle a fault-tolerable deep learning framework. This directory contains the Kubernetes controller. For more information about fault-tolerance, please refer to the design.

We deployed EDL on a real Kubernetes cluster, dlnel.com, opened for graduate students of Tsinghua University. The performance test report of EDL on this cluster is here.

Tutorials

• Usage
• How to Build EDL Component
• Run CTR Training and Deployment on Baidu Cloud

Design Docs

• Collective communication pattern
  • Fault-Tolerant Training in PaddlePaddle.
  • Elastic Deep Learning Design Doc:compute engine.
  • Elastic Deep Learning Design Doc:Scheduler.
  • Run Elastic Deep Learning Demo on a sinle node.

FAQ

TBD

License

PaddlePaddle EDL is provided under the Apache-2.0 license.