fairscaleIntermediate Playground

PyTorch extensions for high-performance large-scale training

fairscale intermediate patternsRun locally
Install
pip install fairscale
Python CodeRun locally

These patterns demonstrate how fairscale is used in production applications.

Challenge

Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?