Anton Sinitsin 02bbd85ed8 Added primitives for speculative decoding and tests (#598) 3 月之前
..
bootstrap.id 8c546d988a Test Llama, rebalancing, throughput eval, and all CLI scripts (#452) 1 年之前
conftest.py 668b736031 Fix logging: do not duplicate lines, enable colors in Colab (#156) 1 年之前
server2.id 8c546d988a Test Llama, rebalancing, throughput eval, and all CLI scripts (#452) 1 年之前
test_aux_functions.py 568f21dc3b Add customizable input tensors (#445) 1 年之前
test_block_exact_match.py 056f22515a Prioritize short inference, unmerge pools for long inference (#458) 1 年之前
test_cache.py 26ebbfe8f0 Support macOS (#477) 1 年之前
test_chained_calls.py d6f4f80f3f Fix Mixtral-related issues (#570) 6 月之前
test_dtype.py cb3f018f9f Add LLaMA support (#323) 1 年之前
test_full_model.py d6f4f80f3f Fix Mixtral-related issues (#570) 6 月之前
test_optimized_layers.py d6f4f80f3f Fix Mixtral-related issues (#570) 6 月之前
test_peft.py b9f0a5467f Support peft LoRA adapters (#335) 1 年之前
test_priority_pool.py 26ebbfe8f0 Support macOS (#477) 1 年之前
test_remote_sequential.py a26559ff65 Fix `.generate(input_ids=...)` (#485) 1 年之前
test_sequence_manager.py 8c546d988a Test Llama, rebalancing, throughput eval, and all CLI scripts (#452) 1 年之前
test_server_stats.py 8c546d988a Test Llama, rebalancing, throughput eval, and all CLI scripts (#452) 1 年之前
test_speculative_generation.py 02bbd85ed8 Added primitives for speculative decoding and tests (#598) 3 月之前
test_tensor_parallel.py 8c546d988a Test Llama, rebalancing, throughput eval, and all CLI scripts (#452) 1 年之前
test_utils.py b9f0a5467f Support peft LoRA adapters (#335) 1 年之前