c45ac42acd
Release / release (push) Waiting to run
* VLLM upgrade to 0.12.0 and compatibility fixes * MAX_NUM_BATCHED_TOKENS fix and CUDA tester * Sys kill worker instead of marking as failed * upgrade to vllm 0.12.0 * Update to vllm 0.15.0 and lora fix * Update for HUB and removal of deprected env variables * reverted docker-bake changes * removed leftovers * Update src/handler.py Co-authored-by: Dj Isaac <contact@dejaydev.com> * Update src/utils.py Co-authored-by: Dj Isaac <contact@dejaydev.com> * Update src/handler.py Co-authored-by: Dj Isaac <contact@dejaydev.com> * Clean up of docs and comments in code * nit: lowercase p * nit: lowercase p --------- Co-authored-by: Dj Isaac <contact@dejaydev.com> Co-authored-by: chrisvela <chris.vela@runpod.io>
15 lines
185 B
Plaintext
15 lines
185 B
Plaintext
ray
|
|
pandas
|
|
pyarrow
|
|
runpod
|
|
huggingface-hub
|
|
packaging
|
|
typing-extensions>=4.8.0
|
|
pydantic
|
|
pydantic-settings
|
|
hf-transfer
|
|
transformers>=4.57.0
|
|
bitsandbytes>=0.45.0
|
|
kernels
|
|
torch-c-dlpack-ext
|