Connor Holmes f0463b4d1f Pass correct node size for ZeRO++ (#4085) | 1 year ago | |
---|---|---|
.. | ||
__init__.py | b361c72761 Update DeepSpeed copyright license to Apache 2.0 (#3111) | 1 year ago |
coalesced_collectives.py | f0463b4d1f Pass correct node size for ZeRO++ (#4085) | 1 year ago |
mpi.py | a655d7d3f8 Switch to torch.linalg.norm (#3984) | 1 year ago |
nccl.py | 6b2365e4fa Re-enable elastic training for torch 2+ (#4010) | 1 year ago |