owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
337 Commits 1 Branch 69 Tags
131c17569fb2fe9641b2f5f1e2d0ba1a6fd6daaa
Commit Graph
337 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
mohamednaji7 131c17569f correct access to "args" dictionary 2025-01-21 22:33:28 +02:00
mohamednaji7 8882f6d50b adding 'bitsandbytes' to QUANTIZATION 2025-01-21 14:46:40 +02:00
mohamednaji7 331bc30101 adding 'bitsandbytes' option 2025-01-21 14:08:37 +02:00
mohamednaji7 a27f72a33a inforce args.quantization for bnb load_froamt 2025-01-21 14:01:32 +02:00
mohamednaji7 7167985f23 including bitsandbytes "src:https://docs.vllm.ai/en/stable/quantization/bnb.html" 2025-01-21 13:49:36 +02:00
pandyamarut 8e3c26be14 update worker-config 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
v1.8.0 		2024-12-30 17:41:10 -08:00
pandyamarut 66ea8b1110 update engine 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-12-30 17:13:03 -08:00
Marut PandyaandGitHub a3d432afdf Merge pull request #140 from runpod-workers/nw-updte 
upgrade vllm version
 2024-12-30 15:23:44 -08:00
pandyamarut 06c2bb1715 upgrade vllm version 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-12-30 15:20:11 -08:00
Marut PandyaandGitHub d2e355eae9 Merge pull request #137 from kldzj/fix-tool-calling 
fix: openai tool calling
 2024-12-15 20:50:47 -08:00
kldzj b7787d8ca8 fix: remove unused import 2024-12-06 16:29:06 +01:00
kldzj b1fca5d257 fix: move tool flags away from engine args 2024-12-06 16:07:23 +01:00
kldzj 3e86d16892 fix: openai tool calling 2024-12-06 13:08:48 +01:00
Marut PandyaandGitHub d9f54ce76a Update README.md 2024-11-29 16:30:45 -08:00
Marut PandyaandGitHub 149da95cd0 Merge pull request #133 from kldzj/tool-calling 
feat: add tool calling flags
 2024-11-29 16:29:56 -08:00
Marut PandyaandGitHub 0a89394f1d Update worker-config.json 2024-11-29 16:29:33 -08:00
Nikolai Kolodziej 8df7f41f1d fix: set empty tool_call_parser to None 2024-11-24 06:55:43 +01:00
Nikolai Kolodziej 4d7b8c03c0 feat: tool calling flags 2024-11-24 06:51:41 +01:00
Marut PandyaandGitHub 2df915a145 Merge pull request #132 from runpod-workers/wc-uo 
update worker-config
v1.7.0 		2024-11-20 14:54:45 -08:00
pandyamarut aadc025849 update worker-config 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-11-20 14:42:56 -08:00
Marut PandyaandGitHub 8b4a49073d Merge pull request #131 from runpod-workers/up-0.6.4 
[Core]Update vllm-0.6.4
 2024-11-20 10:37:46 -08:00
pandyamarut 4e10641d69 update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-11-19 12:14:04 -08:00
Marut PandyaandGitHub 6e8696c12a Merge pull request #121 from sven-knoblauch/lora-modules 
add changes for lora adapter support and /v1/models endpoint
 2024-10-31 15:07:02 -04:00
Marut PandyaandGitHub b49e81a75a Merge pull request #126 from runpod-workers/up-wc-1 
update worker-config
 2024-10-15 17:52:13 -07:00
pandyamarut 65932f85e1 update worker-config 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-10-15 17:47:58 -07:00
Marut PandyaandGitHub 94840cfbbb Update README.md 2024-10-15 17:38:31 -07:00
Marut PandyaandGitHub ce47c41f4a Merge pull request #125 from runpod-workers/up-0.6.3 
update vllm
v1.6.0 		2024-10-15 17:04:20 -07:00
pandyamarut c03ecc42fe update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-10-15 16:49:41 -07:00
Dean QuiñanolaandGitHub ae56b9f43d Merge pull request #123 from runpod-workers/dependency-update-refactored 2024-10-13 20:23:33 -07:00
Dean QuiñanolaandGitHub 891699be1e Merge pull request #124 from runpod-workers/readme-correction 2024-10-13 20:23:05 -07:00
Dean QuiñanolaandGitHub c28aa02576 Update README.md 
v1.5.0 not v15
 2024-10-12 17:11:59 -07:00
Dean QuiñanolaandGitHub eba20c0704 Update CI-runpod_dep.yml 
Dependency has changed to `runpod~=<version>` and not `runpod==<version>`
 2024-10-12 16:47:31 -07:00
Sven Knoblauch 677a01e8f3 update code for case of no lora adapter 2024-10-09 14:51:33 +02:00
Sven Knoblauch 5cd12ba331 add changes for lora adapter support and /v1/models endpoint 2024-10-09 11:01:12 +02:00
Dean QuiñanolaandGitHub 850c686538 Merge pull request #120 from runpod-workers/runpod-v1.7-and-up 
Update requirements.txt to support runpod-python 1.7.*
 2024-10-08 10:52:20 -07:00
Dean QuiñanolaandGitHub de2876e659 Update requirements.txt 2024-10-08 10:48:10 -07:00
Marut PandyaandGitHub d3ee3236c0 Merge pull request #118 from runpod-workers/up-wc 
update worker-config
v1.5.0 		2024-10-01 11:23:02 -07:00
pandyamarut 0781e93054 update worker-config 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-10-01 11:21:27 -07:00
Marut PandyaandGitHub 251e807012 Update README.md 2024-10-01 11:17:30 -07:00
Marut PandyaandGitHub 29346769ed Merge pull request #117 from runpod-workers/up-0.6.2 
update vllm
 2024-10-01 11:05:40 -07:00
pandyamarut 1420091588 update vll 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-27 19:23:50 -07:00
Marut PandyaandGitHub d46adeaee9 Merge pull request #110 from runpod-workers/up-0.6.1 
update vllm v0.6.1
 2024-09-16 15:12:50 -07:00
pandyamarut 5c0dca44bd update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 15:01:21 -07:00
pandyamarut cc301ac123 update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 15:00:01 -07:00
pandyamarut 2ac6a0108f update vllm v0.6.0 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 14:55:40 -07:00
Marut PandyaandGitHub b1554ea10f Merge pull request #109 from runpod-workers/0.5.5-update 
[Update] Docs, bug fix.
v1.3.1 v1.4.0 		2024-09-06 12:36:09 -07:00
pandyamarut 0d794a3914 fix 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 12:26:09 -07:00
pandyamarut 3dad3a754c update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 12:21:34 -07:00
Marut PandyaandGitHub 44cef385df Merge pull request #108 from runpod-workers/cmpl-htf 
[Bug]fix oai completion api error
 2024-09-06 11:06:33 -07:00
pandyamarut 814f50af38 fix oai completion api error 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 11:03:47 -07:00