Marut PandyaandGitHub
6b64bb93bd
completing the "bitsandbytes" option - based on https://docs.vllm.ai/en/stable/quantization/bnb.html
13 lines
157 B
Plaintext
13 lines
157 B
Plaintext
ray
|
|
pandas
|
|
pyarrow
|
|
runpod~=1.7.7
|
|
huggingface-hub
|
|
packaging
|
|
typing-extensions>=4.8.0
|
|
pydantic
|
|
pydantic-settings
|
|
hf-transfer
|
|
transformers
|
|
bitsandbytes>=0.45.0
|