Justin Chiu 4912e0ad7e Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453) | 2 years ago | |
---|---|---|
.. | ||
template_zero0.json | 9caa74e577 Autotuning (#1554) | 2 years ago |
template_zero1.json | 9caa74e577 Autotuning (#1554) | 2 years ago |
template_zero2.json | 9caa74e577 Autotuning (#1554) | 2 years ago |
template_zero3.json | 4912e0ad7e Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453) | 2 years ago |