deepspeed — Intermediate Playground
Microsoft deep learning optimization: ZeRO, model parallelism
deepspeed intermediate patternsRun locally
Install
pip install deepspeedPython Code
Run locally
These patterns demonstrate how deepspeed is used in production applications.
Challenge
Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?