owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
438 Commits 1 Branch 69 Tags
7aa17463d3d5ab8a6693cf56eb8f07a3a7073cc0
Commit Graph
113 Commits
Author SHA1 Message Date
Marut PandyaandGitHub 2f2bd4c749 Revert "feat: added dev & release workflows; added conventions to support AI IDE" 2025-08-09 09:01:52 -07:00
Tim Pietrusky a129cff47d docs: use "version" instead of actual version, so that people can check the releases 2025-07-31 12:03:17 +02:00
Tim Pietrusky b98636e432 feat: added "dev" and "release" workflows; removed "vllm-base-image" as it's not needed 2025-07-28 16:40:20 +02:00
pandyamarut 8839689132 chore(release): v0.9.1 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-06-26 11:06:23 -07:00
pandyamarut 70cd1c8113 update vllm version 0.9.0 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-06-05 11:59:15 -07:00
Marut PandyaandGitHub 23e8ecf85b Merge pull request #169 from RedHitMark/main 
fix lora and multi-lora
 2025-05-14 16:25:26 -07:00
pandyamarut ba19cc97bf update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-05-08 11:34:58 -07:00
Mo KingandGitHub e9d13c155e Update README.md to fix table of contents links to environment variable sections 
Separates environment variables into multiple tables, so that the table of contents will correctly jump to the appropriate section when clicked.
 2025-04-30 12:45:54 -04:00
pandyamarut f33e8d2bcd update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-04-21 13:14:32 -07:00
Marut PandyaandGitHub 6b64bb93bd Merge pull request #147 from mohamednaji7/BitsAndBytes 
completing the "bitsandbytes" option - based on  https://docs.vllm.ai/en/stable/quantization/bnb.html
 2025-04-21 11:39:53 -07:00
pandyamarut 3d067cd472 update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-04-07 11:54:57 -07:00
pandyamarut acbdf63de8 update vllm 0.8.2 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-03-26 15:55:30 -07:00
RedHitMark 084d000324 fix lora and multi-lora 2025-03-14 21:45:09 +01:00
Hailong YangandGitHub fa31d9663d Update README.md 2025-03-11 22:24:22 -04:00
Marut PandyaandGitHub dc6f3239bd Update README.md 2025-02-24 18:39:14 -08:00
pandyamarut c9791f1163 update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-02-11 13:27:57 -08:00
Mohamed NagyandGitHub 04288240f6 updating the . in ['awq', 'squeezellm', 'gptq'. 'bitsandbytes'] for the QUNATIZATION row 2025-02-02 14:58:48 +02:00
pandyamarut 91ed30e9a2 update readme 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-01-28 14:21:33 -08:00
mohamednaji7 8882f6d50b adding 'bitsandbytes' to QUANTIZATION 2025-01-21 14:46:40 +02:00
pandyamarut 06c2bb1715 upgrade vllm version 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-12-30 15:20:11 -08:00
Marut PandyaandGitHub d9f54ce76a Update README.md 2024-11-29 16:30:45 -08:00
Marut PandyaandGitHub 94840cfbbb Update README.md 2024-10-15 17:38:31 -07:00
Dean QuiñanolaandGitHub c28aa02576 Update README.md 
v1.5.0 not v15
 2024-10-12 17:11:59 -07:00
Marut PandyaandGitHub 251e807012 Update README.md 2024-10-01 11:17:30 -07:00
pandyamarut cc301ac123 update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 15:00:01 -07:00
pandyamarut 2ac6a0108f update vllm v0.6.0 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 14:55:40 -07:00
pandyamarut 3dad3a754c update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 12:21:34 -07:00
Marut PandyaandGitHub cdf78e7c89 Update README.md 2024-08-28 23:32:36 -07:00
pandyamarut 3293245c81 update tags 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-28 23:28:39 -07:00
Marut PandyaandGitHub 286d6ba702 Merge pull request #102 from carlson-svg/main 
Add human readable worker-config.json
 2024-08-26 20:22:47 -07:00
carlson-svg 4fa4a8e0e6 added to worker config docs to table of contents + added side note 2024-08-26 01:20:18 -07:00
Marut PandyaandGitHub 2111c9e7a5 Update README.md 2024-08-12 21:02:43 -07:00
Marut PandyaandGitHub 571ef2b805 Update README.md 2024-08-09 14:58:46 -07:00
pandyamarut 967eaba573 change to float 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-09 14:41:07 -07:00
Marut PandyaandGitHub f023f57217 Update README.md 2024-08-07 15:38:26 -07:00
Marut PandyaandGitHub 673597fd46 Update README.md 2024-08-07 15:32:23 -07:00
Marut PandyaandGitHub c50543ebd9 Update README.md 2024-08-07 15:30:33 -07:00
pandyamarut 3498e99b2f update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-05 14:33:56 -07:00
pandyamarut 5da96ce9a6 update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-05 14:26:56 -07:00
Marut PandyaandGitHub e32626ca9d Update README.md 2024-08-05 14:19:38 -07:00
pandyamarut e846ecae9d update readme 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-02 14:13:55 -07:00
Marut PandyaandGitHub 9f066be620 Update README.md 2024-08-02 13:29:18 -07:00
Marut PandyaandGitHub e1b41795f7 Update README.md 2024-07-31 12:46:34 -07:00
Marut PandyaandGitHub 0814d76654 Update README.md 2024-07-30 17:09:01 -07:00
alpayariyak 0e1e38326a Fix deprecated max_context_len_to_capture engine argument 2024-06-13 17:48:05 +00:00
alpayariyak c8458fef2b preparation for 1.0.0 release 2024-06-12 12:28:03 -07:00
Alpay AriyakalpayariyakJannis SchönleberMikael Johansson
 		30cb56a3df Fix MODEL_REVISION env var (Merge pull request #50 from joennlae/rename-revision and #67 from mikljohansson/main) 
Fixed MODEL_REVISION environment variable

Co-Authored-By: Jannis Schönleber <1493766+joennlae@users.noreply.github.com>
Co-Authored-By: Mikael Johansson <mikl.johansson@gmail.com>
 2024-05-09 20:45:07 -04:00
alpayariyak 9f2cb7b1d0 Update documentation to include rename of fp8_e5m2 to fp8 2024-05-09 23:59:11 +00:00
Alpay AriyakandGitHub 4f61b04afe Update README.md 2024-05-09 01:05:04 -04:00
Alpay Ariyakandalpayariyak 874379a0c5 1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62) 2024-05-09 00:42:08 -04:00