deepspeedEasy Playground

Microsoft deep learning optimization: ZeRO, model parallelism

Getting started with deepspeedRun locally
Install
pip install deepspeed
Python CodeRun locally
Expected Output
# Expected output shown below
# (Run locally with: deepspeed)

deepspeed is a third-party package. Microsoft deep learning optimization: ZeRO, model parallelism. Install with: pip install deepspeed

Challenge

Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?