fairscale — Intermediate Playground
PyTorch extensions for high-performance large-scale training
fairscale intermediate patternsRun locally
Install
pip install fairscalePython CodeRun locally
These patterns demonstrate how fairscale is used in production applications.
Challenge
Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?