fairscaleExpert Playground

PyTorch extensions for high-performance large-scale training

fairscale expert patternsRun locally
Install
pip install fairscale
Python CodeRun locally

Expert-level fairscale usage for performance-critical and production-grade applications.

Challenge

Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?