| .. |
|
__init__.py
|
05faa0b3c8
add quantization script for cpu
|
2 years ago |
|
config.json
|
a798ea04a6
add minimalistic benchmarks
|
2 years ago |
|
convert_model.py
|
e2711a033b
Add automated tests (#23)
|
2 years ago |
|
demo_deploy_server.sh
|
564f6edb07
set throughput=1.0 to fix zero throughput problem
|
2 years ago |
|
deploy_server.sh
|
cf86dcc457
update scripts
|
2 years ago |
|
inference_one_block.py
|
4695071ad2
WIP: make DistributedBloom compliant with HF interface
|
2 years ago |
|
local_server_config_example.cfg
|
f60a7dd183
deploy swarm on local & remote machines
|
2 years ago |
|
remote_server_config_example.cfg
|
f60a7dd183
deploy swarm on local & remote machines
|
2 years ago |
|
run_local_servers.sh
|
cf86dcc457
update scripts
|
2 years ago |
|
run_remote_servers.sh
|
6573076883
Sequential and parallel forward / backward (#36)
|
2 years ago |
|
run_server.py
|
cf86dcc457
update scripts
|
2 years ago |
|
speed_test.py
|
e2711a033b
Add automated tests (#23)
|
2 years ago |
dbaranchuk
cf86dcc457
update scripts