deepspeed — Expert Playground

Microsoft deep learning optimization: ZeRO, model parallelism

deepspeed expert patternsRun locally

Install

pip install deepspeed

Python CodeRun locally

# Install: pip install deepspeed
import deepspeed

# Expert-level deepspeed usage
# Performance optimization and internals
print("deepspeed expert patterns")

# Install: pip install deepspeed
import deepspeed

# Expert-level deepspeed usage
# Performance optimization and internals
print("deepspeed expert patterns")

Expert-level deepspeed usage for performance-critical and production-grade applications.

Challenge

Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?

View all Expert examples for deepspeed