 Marut PandyaandGitHub
|
6b64bb93bd
|
Merge pull request #147 from mohamednaji7/BitsAndBytes
completing the "bitsandbytes" option - based on https://docs.vllm.ai/en/stable/quantization/bnb.html
|
2025-04-21 11:39:53 -07:00 |
|
|
Marut PandyaandGitHub
|
d77c53c3b7
|
Merge pull request #175 from runpod-workers/up-0.8.3
update vllm
v2.3.0
v2.3.1
v2.3.2
|
2025-04-07 11:58:03 -07:00 |
|
|
pandyamarut
|
3d067cd472
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-07 11:54:57 -07:00 |
|
|
Marut PandyaandGitHub
|
f1360ccae7
|
Merge pull request #173 from KAJdev/patch-1
Update hub.json
|
2025-04-03 14:52:06 -07:00 |
|
|
Marut PandyaandGitHub
|
96f1b86126
|
Merge pull request #174 from KAJdev/patch-2
Update tests.json
|
2025-04-03 10:14:49 -07:00 |
|
|
Ezekiel WotringandGitHub
|
3a095f3e10
|
Update tests.json
|
2025-04-03 09:10:01 -08:00 |
|
|
Ezekiel WotringandGitHub
|
7cf7f3e4e6
|
Update hub.json
|
2025-04-03 09:04:28 -08:00 |
|
|
Marut PandyaandGitHub
|
4395d0c67b
|
Update hub.json
v2.2.2
|
2025-04-03 08:10:28 -07:00 |
|
|
Marut PandyaandGitHub
|
5864fa6843
|
Update hub.json
v.2.2.1
|
2025-03-31 15:55:35 -07:00 |
|
|
Marut PandyaandGitHub
|
067f0bc173
|
Update tests.json
|
2025-03-31 15:49:31 -07:00 |
|
|
Marut PandyaandGitHub
|
0869068e7c
|
Create tests.json
|
2025-03-31 15:32:06 -07:00 |
|
|
Marut PandyaandGitHub
|
19f25b17de
|
Update hub.json
|
2025-03-31 15:14:40 -07:00 |
|
|
Marut PandyaandGitHub
|
70aa748c30
|
Update hub.json
|
2025-03-31 15:14:24 -07:00 |
|
|
Marut PandyaandGitHub
|
da3e5f524b
|
Merge pull request #171 from runpod-workers/update
update vllm 0.8.2
v2.2.0
|
2025-03-26 15:56:04 -07:00 |
|
|
pandyamarut
|
acbdf63de8
|
update vllm 0.8.2
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-26 15:55:30 -07:00 |
|
|
Hailong YangandGitHub
|
fa31d9663d
|
Update README.md
|
2025-03-11 22:24:22 -04:00 |
|
|
Marut PandyaandGitHub
|
b8fb313483
|
Merge pull request #168 from runpod-workers/wc-up
update worker config
|
2025-03-11 12:23:22 -07:00 |
|
|
pandyamarut
|
9635daf336
|
update worker config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-11 12:22:53 -07:00 |
|
|
Marut PandyaandGitHub
|
fb4e700090
|
Merge pull request #166 from KAJdev/patch-1
Create hub.json
|
2025-03-10 12:14:47 -07:00 |
|
|
Marut PandyaandGitHub
|
d4872ed9c8
|
Merge pull request #167 from runpod-workers/rachfop-patch-1
Update requirements.txt
|
2025-03-10 12:13:47 -07:00 |
|
|
Patrick RachfordandGitHub
|
b2eef50c3b
|
Update requirements.txt
Use the latest runpod version from here:
https://github.com/runpod/runpod-python/releases/tag/1.7.7
|
2025-03-10 08:46:28 -07:00 |
|
|
Ezekiel WotringandGitHub
|
8005bcc1a8
|
fix description
|
2025-03-07 13:22:34 -09:00 |
|
|
Ezekiel WotringandGitHub
|
aa7b00ddda
|
Create hub.json
|
2025-03-07 13:20:52 -09:00 |
|
|
Marut PandyaandGitHub
|
dc6f3239bd
|
Update README.md
v2.1.0
|
2025-02-24 18:39:14 -08:00 |
|
|
Marut PandyaandGitHub
|
f9d0fcb78c
|
Merge pull request #165 from runpod-workers/hfix
[HF]: set default max_token size
|
2025-02-24 17:24:50 -08:00 |
|
|
pandyamarut
|
99b952e55e
|
set default max_token size
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 17:22:44 -08:00 |
|
|
Marut PandyaandGitHub
|
389fad7952
|
Merge pull request #164 from runpod-workers/up-0.7.3
update vllm
|
2025-02-24 15:08:02 -08:00 |
|
|
pandyamarut
|
56dc4ad075
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 15:01:45 -08:00 |
|
|
Marut PandyaandGitHub
|
6dcf39e159
|
Merge pull request #161 from runpod-workers/revert-157-m-c
Revert "Enabling model caching."
|
2025-02-18 14:33:27 -08:00 |
|
|
Marut PandyaandGitHub
|
2b1d618287
|
Revert "Enabling model caching."
|
2025-02-18 10:45:47 -08:00 |
|
|
Marut PandyaandGitHub
|
d7e9c49fe4
|
Merge pull request #160 from runpod-workers/up-0.7.2
update vllm
|
2025-02-11 13:59:18 -08:00 |
|
|
pandyamarut
|
c9791f1163
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-11 13:27:57 -08:00 |
|
|
Marut PandyaandGitHub
|
6fc770415d
|
Merge pull request #157 from runpod-workers/m-c
Enabling model caching.
|
2025-02-06 11:52:19 -08:00 |
|
|
Mohamed NagyandGitHub
|
04288240f6
|
updating the . in ['awq', 'squeezellm', 'gptq'. 'bitsandbytes'] for the QUNATIZATION row
|
2025-02-02 14:58:48 +02:00 |
|
|
Marut PandyaandGitHub
|
9e8d9196b0
|
Merge pull request #154 from runpod-workers/fx-eng
update engine.py
v1.9.0
|
2025-01-28 21:40:26 -08:00 |
|
|
pandyamarut
|
30dd7c1eb5
|
update engine.py
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 21:40:00 -08:00 |
|
|
Marut PandyaandGitHub
|
aa7c37ffb0
|
Merge pull request #152 from runpod-workers/fix0.7.0-1
update oai serving classes
|
2025-01-28 20:58:40 -08:00 |
|
|
pandyamarut
|
dc8c88027a
|
update serving classes
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 20:58:07 -08:00 |
|
|
Marut PandyaandGitHub
|
a948e90caa
|
Merge pull request #151 from runpod-workers/fix0.7.0
dynamic lora loading
|
2025-01-28 19:02:59 -08:00 |
|
|
pandyamarut
|
c703254f71
|
dynamic lora loading
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 19:00:57 -08:00 |
|
|
Marut PandyaandGitHub
|
2747106403
|
Merge pull request #150 from runpod-workers/up-0.7.0
update vllm 0.7.0
|
2025-01-28 14:27:37 -08:00 |
|
|
pandyamarut
|
91ed30e9a2
|
update readme
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:21:33 -08:00 |
|
|
pandyamarut
|
fcbfe84f63
|
update vllm 0.7.0
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:18:10 -08:00 |
|
|
Marut PandyaandGitHub
|
610429df23
|
Merge pull request #143 from sihamouda/main
Add limit_mm_per_prompt engine argument for multimodels input
|
2025-01-27 16:41:47 -08:00 |
|
|
Hailong Yang
|
a578c6df23
|
update docker file
|
2025-01-26 23:28:27 -05:00 |
|
|
Mohamed NagyandGitHub
|
9299f43b8b
|
solving "typing_extensions" compatibility with "bitsandbytes"
```
2025-01-22 18:04:01 [INFO] > [stage-0 5/8] RUN --mount=type=cache,target=/root/.cache/pip python3 -m pip install --upgrade pip && python3 -m pip install --upgrade -r /requirements.txt:
2025-01-22 18:04:01 [INFO] #13 8.904
2025-01-22 18:04:01 [INFO] #13 8.904 The conflict is caused by:
2025-01-22 18:04:01 [INFO] #13 8.904 The user requested typing-extensions==4.7.1
2025-01-22 18:04:01 [INFO] #13 8.904 bitsandbytes 0.45.0 depends on typing_extensions>=4.8.0
```
|
2025-01-22 18:06:46 +02:00 |
|
|
mohamednaji7
|
131c17569f
|
correct access to "args" dictionary
|
2025-01-21 22:33:28 +02:00 |
|
|
mohamednaji7
|
8882f6d50b
|
adding 'bitsandbytes' to QUANTIZATION
|
2025-01-21 14:46:40 +02:00 |
|
|
mohamednaji7
|
331bc30101
|
adding 'bitsandbytes' option
|
2025-01-21 14:08:37 +02:00 |
|
|
mohamednaji7
|
a27f72a33a
|
inforce args.quantization for bnb load_froamt
|
2025-01-21 14:01:32 +02:00 |
|