Pipeline Parallelism
====================

Model Specification
--------------------
.. autoclass:: deepspeed.pipe.PipelineModule
    :members:

.. autoclass:: deepspeed.pipe.LayerSpec
    :members:

.. autoclass:: deepspeed.pipe.TiedLayerSpec
    :members:


Training
--------
.. automodule:: deepspeed.runtime.pipe.engine
    :members:

Extending Pipeline Parallelism
------------------------------
.. automodule:: deepspeed.runtime.pipe.schedule
    :members: