owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

OpenAI Compatibility, Dynamic Batching, Refactor

Browse Source
This commit is contained in:
alpayariyak
2024-02-21 04:36:04 +00:00
parent a94ef66f71
commit e191149259
10 changed files with 61 additions and 237 deletions
Download Patch File Download Diff File Expand all files Collapse all files
builder/requirements.txt
+1 -1
View File
@@ -2,7 +2,7 @@ hf_transfer
ray
pandas
pyarrow
runpod==1.5.3
runpod==1.6.2
huggingface-hub
packaging
typing-extensions==4.7.1