Codes
Register Sign In
English
English 简体中文
openoker
/
DeepSpeed
1
0
Fork 0
Files Issues 0 Wiki
Branch: mosm/softmax-longseq
Branches Tags
Jeff Rasley da84e60d98 add missing license info to top of all source code (#2889) 1 year ago
..
README.md 4cf970e6bb Add codespell to pre-commit checks (#1717) 2 years ago
__init__.py da84e60d98 add missing license info to top of all source code (#2889) 1 year ago
base_tuner.py da84e60d98 add missing license info to top of all source code (#2889) 1 year ago
cost_model.py da84e60d98 add missing license info to top of all source code (#2889) 1 year ago
index_based_tuner.py da84e60d98 add missing license info to top of all source code (#2889) 1 year ago
model_based_tuner.py da84e60d98 add missing license info to top of all source code (#2889) 1 year ago
utils.py da84e60d98 add missing license info to top of all source code (#2889) 1 year ago

README.md

Tuner

exps is a list of experiment descriptions (dictionaries). An experimentation description has a ds_config field that stores the DeepSpeed configuration to be used in the experiment.

A tuner is based on BaseTuner and at least implements the next_batch method. It can implement a different tune method from the BaseTuner's.

class NewTuner(BaseTuner):
    def __init__(self, exps: list, resource_manager):
        super(NewTuner, self).__init__(exps, resource_manager)

    def next_batch(self, sample_size=1):
        pass

    def tune(self): # if it differs from BaseTuner
        pass