1234567891011121314151617181920212223242526 |
- Pipeline Parallelism
- ====================
- Model Specification
- --------------------
- .. autoclass:: deepspeed.pipe.PipelineModule
- :members:
- .. autoclass:: deepspeed.pipe.LayerSpec
- :members:
- .. autoclass:: deepspeed.pipe.TiedLayerSpec
- :members:
- .. autoclass:: deepspeed.runtime.pipe.ProcessTopology
- :members:
- Training
- --------
- .. automodule:: deepspeed.runtime.pipe.engine
- :members:
- Extending Pipeline Parallelism
- ------------------------------
- .. automodule:: deepspeed.runtime.pipe.schedule
- :members:
|