deepspeed

Package — Deep LearningPython 3.7+Advanced

Microsoft deep learning optimization: ZeRO, model parallelism

Quick Info

Documentation: Official Docs
Python Version: 3.7+
Dependencies: PyTorch, NumPy, packaging, psutil, tqdm, ninja, pydantic, hjson, py-cpuinfo
Install: pip install deepspeed

python

# Install: pip install deepspeed
import deepspeed

# Basic deepspeed usage
print(f"Using deepspeed")
# See documentation for detailed examples

deepspeed is a third-party package. Microsoft deep learning optimization: ZeRO, model parallelism. Install with: pip install deepspeed