deepspeed — Intermediate Playground
Microsoft deep learning optimization: ZeRO, model parallelism
deepspeed intermediate patternsRun locally
Install
pip install deepspeedPython CodeRun locally
These patterns demonstrate how deepspeed is used in production applications.
Challenge
Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?