owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
327 Commits 1 Branch 69 Tags
b7787d8ca89b367cc224c16ba378fdaddcbfa5c3
Commit Graph
327 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
kldzj b7787d8ca8 fix: remove unused import 2024-12-06 16:29:06 +01:00
kldzj b1fca5d257 fix: move tool flags away from engine args 2024-12-06 16:07:23 +01:00
kldzj 3e86d16892 fix: openai tool calling 2024-12-06 13:08:48 +01:00
Marut PandyaandGitHub d9f54ce76a Update README.md 2024-11-29 16:30:45 -08:00
Marut PandyaandGitHub 149da95cd0 Merge pull request #133 from kldzj/tool-calling 
feat: add tool calling flags
 2024-11-29 16:29:56 -08:00
Marut PandyaandGitHub 0a89394f1d Update worker-config.json 2024-11-29 16:29:33 -08:00
Nikolai Kolodziej 8df7f41f1d fix: set empty tool_call_parser to None 2024-11-24 06:55:43 +01:00
Nikolai Kolodziej 4d7b8c03c0 feat: tool calling flags 2024-11-24 06:51:41 +01:00
Marut PandyaandGitHub 2df915a145 Merge pull request #132 from runpod-workers/wc-uo 
update worker-config
v1.7.0 		2024-11-20 14:54:45 -08:00
pandyamarut aadc025849 update worker-config 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-11-20 14:42:56 -08:00
Marut PandyaandGitHub 8b4a49073d Merge pull request #131 from runpod-workers/up-0.6.4 
[Core]Update vllm-0.6.4
 2024-11-20 10:37:46 -08:00
pandyamarut 4e10641d69 update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-11-19 12:14:04 -08:00
Marut PandyaandGitHub 6e8696c12a Merge pull request #121 from sven-knoblauch/lora-modules 
add changes for lora adapter support and /v1/models endpoint
 2024-10-31 15:07:02 -04:00
Marut PandyaandGitHub b49e81a75a Merge pull request #126 from runpod-workers/up-wc-1 
update worker-config
 2024-10-15 17:52:13 -07:00
pandyamarut 65932f85e1 update worker-config 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-10-15 17:47:58 -07:00
Marut PandyaandGitHub 94840cfbbb Update README.md 2024-10-15 17:38:31 -07:00
Marut PandyaandGitHub ce47c41f4a Merge pull request #125 from runpod-workers/up-0.6.3 
update vllm
v1.6.0 		2024-10-15 17:04:20 -07:00
pandyamarut c03ecc42fe update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-10-15 16:49:41 -07:00
Dean QuiñanolaandGitHub ae56b9f43d Merge pull request #123 from runpod-workers/dependency-update-refactored 2024-10-13 20:23:33 -07:00
Dean QuiñanolaandGitHub 891699be1e Merge pull request #124 from runpod-workers/readme-correction 2024-10-13 20:23:05 -07:00
Dean QuiñanolaandGitHub c28aa02576 Update README.md 
v1.5.0 not v15
 2024-10-12 17:11:59 -07:00
Dean QuiñanolaandGitHub eba20c0704 Update CI-runpod_dep.yml 
Dependency has changed to `runpod~=<version>` and not `runpod==<version>`
 2024-10-12 16:47:31 -07:00
Sven Knoblauch 677a01e8f3 update code for case of no lora adapter 2024-10-09 14:51:33 +02:00
Sven Knoblauch 5cd12ba331 add changes for lora adapter support and /v1/models endpoint 2024-10-09 11:01:12 +02:00
Dean QuiñanolaandGitHub 850c686538 Merge pull request #120 from runpod-workers/runpod-v1.7-and-up 
Update requirements.txt to support runpod-python 1.7.*
 2024-10-08 10:52:20 -07:00
Dean QuiñanolaandGitHub de2876e659 Update requirements.txt 2024-10-08 10:48:10 -07:00
Marut PandyaandGitHub d3ee3236c0 Merge pull request #118 from runpod-workers/up-wc 
update worker-config
v1.5.0 		2024-10-01 11:23:02 -07:00
pandyamarut 0781e93054 update worker-config 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-10-01 11:21:27 -07:00
Marut PandyaandGitHub 251e807012 Update README.md 2024-10-01 11:17:30 -07:00
Marut PandyaandGitHub 29346769ed Merge pull request #117 from runpod-workers/up-0.6.2 
update vllm
 2024-10-01 11:05:40 -07:00
pandyamarut 1420091588 update vll 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-27 19:23:50 -07:00
Marut PandyaandGitHub d46adeaee9 Merge pull request #110 from runpod-workers/up-0.6.1 
update vllm v0.6.1
 2024-09-16 15:12:50 -07:00
pandyamarut 5c0dca44bd update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 15:01:21 -07:00
pandyamarut cc301ac123 update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 15:00:01 -07:00
pandyamarut 2ac6a0108f update vllm v0.6.0 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 14:55:40 -07:00
Marut PandyaandGitHub b1554ea10f Merge pull request #109 from runpod-workers/0.5.5-update 
[Update] Docs, bug fix.
v1.3.1 v1.4.0 		2024-09-06 12:36:09 -07:00
pandyamarut 0d794a3914 fix 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 12:26:09 -07:00
pandyamarut 3dad3a754c update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 12:21:34 -07:00
Marut PandyaandGitHub 44cef385df Merge pull request #108 from runpod-workers/cmpl-htf 
[Bug]fix oai completion api error
 2024-09-06 11:06:33 -07:00
pandyamarut 814f50af38 fix oai completion api error 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 11:03:47 -07:00
Marut PandyaandGitHub f3a530b7fe Merge pull request #107 from runpod-workers/pandyamarut-patch-1 
Update README.md
 2024-08-28 23:32:48 -07:00
Marut PandyaandGitHub cdf78e7c89 Update README.md 2024-08-28 23:32:36 -07:00
Marut PandyaandGitHub ab40d9c9a8 Merge pull request #106 from runpod-workers/up-0.5.5 
update vllm version 0.5.5
 2024-08-28 23:31:15 -07:00
pandyamarut 3293245c81 update tags 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-28 23:28:39 -07:00
pandyamarut 5e1c8c8128 update vllm version 0.5.5 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-28 22:46:45 -07:00
Marut PandyaandGitHub 286d6ba702 Merge pull request #102 from carlson-svg/main 
Add human readable worker-config.json
v1.3.0 		2024-08-26 20:22:47 -07:00
carlson-svg 8d734f8340 Merge branch 'add-worker-config' 2024-08-26 01:25:09 -07:00
carlson-svg 4fa4a8e0e6 added to worker config docs to table of contents + added side note 2024-08-26 01:20:18 -07:00
carlson-svg 39ce8a64c0 initial documentation for worker-config.json 2024-08-22 15:40:54 -07:00
carlson-svg 825ef25b60 changed to minimumCudaVersion to camel case 2024-08-21 12:47:48 -07:00