deepspeedIntermediate Playground

Microsoft deep learning optimization: ZeRO, model parallelism

deepspeed intermediate patternsRun locally
Install
pip install deepspeed
Python CodeRun locally

These patterns demonstrate how deepspeed is used in production applications.

Challenge

Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?