fairscaleEasy Playground

PyTorch extensions for high-performance large-scale training

Getting started with fairscaleRun locally
Install
pip install fairscale
Python CodeRun locally
Expected Output
# Expected output shown below
# (Run locally with: fairscale)

fairscale is a third-party package. PyTorch extensions for high-performance large-scale training. Install with: pip install fairscale

Challenge

Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?