Commit Graph

Select branches

Hide Pull Requests

main

0.1.0

0.2.0

0.2.1

0.2.2

0.2.3

0.3.0

0.3.1

0.3.2

1.0.0

1.0.1

v.2.15.0

v.2.16.0

v.2.2.1

v1.1

v1.2.0

v1.3.0

v1.3.1

v1.4.0

v1.5.0

v1.6.0

v1.7.0

v1.8.0

v1.9.0

v2.1.0

v2.10.0

v2.11.0

v2.11.1

v2.11.2

v2.11.3

v2.12.0

v2.12.1

v2.12.2

v2.12.3

v2.13.0

v2.13.1

v2.14.0

v2.17.0

v2.18.0

v2.18.1

v2.19.0

v2.19.1

v2.19.2

v2.2.0

v2.2.2

v2.20.0

v2.20.1

v2.21.1

v2.22.0

v2.22.1

v2.22.2

v2.22.3

v2.22.4

v2.22.5

v2.23.0

v2.3.0

v2.3.1

v2.3.2

v2.4.0

v2.5.0

v2.5.1

v2.6.0

v2.8.0

v2.9.0

v2.9.1

v2.9.2

v2.9.3

v2.9.4

v2.9.5

v2.9.6

Mono Color

• 891699be1e Merge pull request #124 from runpod-workers/readme-correction Dean QuiñanolaandGitHub 2024-10-13 20:23:05 -07:00
• c28aa02576 Update README.md Dean QuiñanolaandGitHub 2024-10-12 17:11:59 -07:00
• eba20c0704 Update CI-runpod_dep.yml Dean QuiñanolaandGitHub 2024-10-12 16:47:31 -07:00
• 677a01e8f3 update code for case of no lora adapter Sven Knoblauch 2024-10-09 14:51:33 +02:00
• 5cd12ba331 add changes for lora adapter support and /v1/models endpoint Sven Knoblauch 2024-10-09 11:01:12 +02:00
• 850c686538 Merge pull request #120 from runpod-workers/runpod-v1.7-and-up Dean QuiñanolaandGitHub 2024-10-08 10:52:20 -07:00
• de2876e659 Update requirements.txt Dean QuiñanolaandGitHub 2024-10-08 10:48:10 -07:00
• d3ee3236c0 Merge pull request #118 from runpod-workers/up-wc v1.5.0 Marut PandyaandGitHub 2024-10-01 11:23:02 -07:00
• 0781e93054 update worker-config pandyamarut 2024-10-01 11:21:27 -07:00
• 251e807012 Update README.md Marut PandyaandGitHub 2024-10-01 11:17:30 -07:00
• 29346769ed Merge pull request #117 from runpod-workers/up-0.6.2 Marut PandyaandGitHub 2024-10-01 11:05:40 -07:00
• 1420091588 update vll pandyamarut 2024-09-27 19:23:50 -07:00
• d46adeaee9 Merge pull request #110 from runpod-workers/up-0.6.1 Marut PandyaandGitHub 2024-09-16 15:12:50 -07:00
• 5c0dca44bd update pandyamarut 2024-09-16 15:01:21 -07:00
• cc301ac123 update pandyamarut 2024-09-16 15:00:01 -07:00
• 2ac6a0108f update vllm v0.6.0 pandyamarut 2024-09-16 14:55:40 -07:00
• b1554ea10f Merge pull request #109 from runpod-workers/0.5.5-update v1.4.0 v1.3.1 Marut PandyaandGitHub 2024-09-06 12:36:09 -07:00
• 0d794a3914 fix pandyamarut 2024-09-06 12:26:09 -07:00
• 3dad3a754c update vllm pandyamarut 2024-09-06 12:21:34 -07:00
• 44cef385df Merge pull request #108 from runpod-workers/cmpl-htf Marut PandyaandGitHub 2024-09-06 11:06:33 -07:00
• 814f50af38 fix oai completion api error pandyamarut 2024-09-06 11:03:47 -07:00
• f3a530b7fe Merge pull request #107 from runpod-workers/pandyamarut-patch-1 Marut PandyaandGitHub 2024-08-28 23:32:48 -07:00
• cdf78e7c89 Update README.md Marut PandyaandGitHub 2024-08-28 23:32:36 -07:00
• ab40d9c9a8 Merge pull request #106 from runpod-workers/up-0.5.5 Marut PandyaandGitHub 2024-08-28 23:31:15 -07:00
• 3293245c81 update tags pandyamarut 2024-08-28 23:28:39 -07:00
• 5e1c8c8128 update vllm version 0.5.5 pandyamarut 2024-08-28 22:46:45 -07:00
• 286d6ba702 Merge pull request #102 from carlson-svg/main v1.3.0 Marut PandyaandGitHub 2024-08-26 20:22:47 -07:00
• 8d734f8340 Merge branch 'add-worker-config' carlson-svg 2024-08-26 01:25:09 -07:00
• 4fa4a8e0e6 added to worker config docs to table of contents + added side note carlson-svg 2024-08-26 01:20:18 -07:00
• 39ce8a64c0 initial documentation for worker-config.json carlson-svg 2024-08-22 15:40:54 -07:00
• 825ef25b60 changed to minimumCudaVersion to camel case carlson-svg 2024-08-21 12:47:48 -07:00
• 1e9aeb6e8f adding "minimum_cuda_version" to each version carlson-svg 2024-08-21 12:44:45 -07:00
• e6172dddd4 took out space in imageName from version 0.5.4 carlson-svg 2024-08-19 15:17:20 -07:00
• 21a1e138b4 updated version of human readable config carlson-svg 2024-08-18 23:57:19 -07:00
• a40e7803ee converted to human readable format carlson-svg 2024-08-18 23:24:40 -07:00
• 5e245793bc Merge pull request #1 from carlson-svg/add-worker-config CarlsonandGitHub 2024-08-13 20:43:47 -07:00
• 2111c9e7a5 Update README.md Marut PandyaandGitHub 2024-08-12 21:02:43 -07:00
• 0ae11ea6df v0 worker-config carlson-svg 2024-08-09 15:10:08 -07:00
• 7f46582949 Merge pull request #96 from runpod-workers/rel-v0.5.4 Marut PandyaandGitHub 2024-08-09 15:01:16 -07:00
• 571ef2b805 Update README.md Marut PandyaandGitHub 2024-08-09 14:58:46 -07:00
• 967eaba573 change to float pandyamarut 2024-08-09 14:41:07 -07:00
• eb75a3ac03 Merge pull request #95 from runpod-workers/runpod-package-update v1.2.0 Marut PandyaandGitHub 2024-08-09 12:04:25 -07:00
• 9cb9336cf5 update vllm version 0.5.4 pandyamarut 2024-08-09 12:01:42 -07:00
• 6a15a9e750 Update package version pandyamarutandGitHub 2024-08-07 22:38:37 +00:00
• f023f57217 Update README.md Marut PandyaandGitHub 2024-08-07 15:38:26 -07:00
• 673597fd46 Update README.md Marut PandyaandGitHub 2024-08-07 15:32:23 -07:00
• c50543ebd9 Update README.md Marut PandyaandGitHub 2024-08-07 15:30:33 -07:00
• 17a2d844ec Merge pull request #93 from runpod-workers/up-rdme Marut PandyaandGitHub 2024-08-05 14:36:39 -07:00
• 3498e99b2f update pandyamarut 2024-08-05 14:33:56 -07:00
• 5da96ce9a6 update pandyamarut 2024-08-05 14:26:56 -07:00
• e32626ca9d Update README.md Marut PandyaandGitHub 2024-08-05 14:19:38 -07:00
• 37d140aba6 Update docker-bake.hcl v1.1 Marut PandyaandGitHub 2024-08-02 16:53:59 -07:00
• 66ed2a2a5f Merge pull request #90 from runpod-workers/pandyamarut-patch-1 Marut PandyaandGitHub 2024-08-02 16:03:18 -07:00
• e846ecae9d update readme pandyamarut 2024-08-02 14:13:55 -07:00
• 9f066be620 Update README.md Marut PandyaandGitHub 2024-08-02 13:29:18 -07:00
• 8a010c3804 Merge pull request #82 from runpod-workers/any-arg-and-refactor Marut PandyaandGitHub 2024-08-01 15:28:11 -07:00
• 14cacd55fe update docker pandyamarut 2024-07-31 18:44:46 -07:00
• e1b41795f7 Update README.md Marut PandyaandGitHub 2024-07-31 12:46:34 -07:00
• 0814d76654 Update README.md Marut PandyaandGitHub 2024-07-30 17:09:01 -07:00
• f3534a4ea7 fix openai compat pandyamarut 2024-07-27 15:49:45 -07:00
• b61ea5ea46 Delete test.py Marut PandyaandGitHub 2024-07-26 17:32:16 -07:00
• 0f8657e58d update env default args pandyamarut 2024-07-26 16:52:51 -07:00
• bd96b5e0de update v0.5.3.post1 pandyamarut 2024-07-25 21:29:45 -07:00
• 5bd6f3a75e 0.5.3, any vllm arg as env var, refactor and fixes, moving away from building separate image from vLLM fork alpayariyak 2024-07-25 19:40:32 +00:00
• a08d83f600 Allow any vLLM engine args as env vars, refactor alpayariyak 2024-07-02 19:44:01 +00:00
• 0e1e38326a Fix deprecated max_context_len_to_capture engine argument 1.0.1 alpayariyak 2024-06-13 17:48:05 +00:00
• c8458fef2b preparation for 1.0.0 release 1.0.0 alpayariyak 2024-06-10 20:51:47 +00:00
• bad5ddd892 Fix vLLM 0.4.1 bug for OpenAI /models route alpayariyak 2024-06-10 20:38:49 +00:00
• f19ce12ab0 Fix Building Docker with model built-in #71 alpayariyak 2024-05-15 20:32:01 +00:00
• 1bb6f84541 Deprecated kv cache dtype warning alpayariyak 2024-05-10 16:29:20 +00:00
• 30cb56a3df Fix MODEL_REVISION env var (Merge pull request #50 from joennlae/rename-revision and #67 from mikljohansson/main) 4 people 2024-05-09 20:41:07 -04:00
• 00add8707a Temporarily disable build and push github actions alpayariyak 2024-05-09 20:33:52 -04:00
• ec7ea0b760 Update default base image version to fix github actions build alpayariyak 2024-05-10 00:00:48 +00:00
• 9f2cb7b1d0 Update documentation to include rename of fp8_e5m2 to fp8 alpayariyak 2024-05-09 23:59:11 +00:00
• 4abe494635 Fix hf-transfer error alpayariyak 2024-05-09 23:51:07 +00:00
• 4f61b04afe Update README.md Alpay AriyakandGitHub 2024-05-09 01:05:04 -04:00
• 874379a0c5 1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62) Alpay Ariyakandalpayariyak 2024-05-09 00:40:46 -04:00
• f06a64d5b9 Fixed MODEL_REVISION environment variable Mikael Johansson 2024-05-02 13:45:43 +02:00
• 0a5b5bc095 Add badges alpayariyak 2024-03-15 20:49:51 -04:00
• 2936e4d95d Update automatic builds, documentation alpayariyak 2024-03-14 20:40:03 +00:00
• cee4e484d5 Update README.md for 0.3.2 0.3.2 Alpay AriyakandGitHub 2024-03-12 19:07:37 -04:00
• 6160769996 Release 0.3.2 Alpay AriyakandGitHub 2024-03-12 17:44:47 -05:00
• d25b6f9628 Fix sampling params alpayariyak 2024-03-12 22:15:57 +00:00
• c8ee100d80 Small refactor alpayariyak 2024-03-06 17:08:57 +00:00
• fee8d8eee4 Fix submodule alpayariyak 2024-03-05 19:17:53 +00:00
• db7167d57f 0.3.3 alpayariyak 2024-03-05 19:14:35 +00:00
• d91ccb866f 0.3.1: bug fixes 0.3.1 Alpay Ariyakandalpayariyak 2024-02-28 18:55:51 -05:00
• 36e9b670ee Add notice on what to do when HuggingFace is down Alpay AriyakandGitHub 2024-02-28 17:10:39 -05:00
• 91167b873a v0.3.0: OpenAI Compatibility, Dynamic Stream Batching, Refactor, Error Catching 0.3.0 Alpay Ariyakandalpayariyak 2024-02-23 22:25:43 -05:00
• 819102cfd6 Merge branch 'openai-sse-output' of https://github.com/runpod-workers/worker-vllm into openai-sse-output alpayariyak 2024-02-24 03:18:37 +00:00
• 985bbf1cb5 Fix Multi-GPU, tokenizer trust remote code alpayariyak 2024-02-24 03:18:25 +00:00
• 6f5718f191 Update Docker image tag in README.md Alpay AriyakandGitHub 2024-02-23 02:15:50 -05:00
• 235d0d31d0 Merge pull request #50 from runpod-workers/tagged-releases Alpay AriyakandGitHub 2024-02-22 23:14:57 -05:00
• 708f68d7f8 Final Bug fixes, configurable oai response role, served model name override, documentation alpayariyak 2024-02-23 04:14:03 +00:00
• b42d45ce0f Bug fixes, refactors alpayariyak 2024-02-23 03:46:47 +00:00
• 7221caceff feat: auto build cuda version Justin Merrell 2024-02-22 20:48:54 -05:00
• a2d9535652 Update documentation further alpayariyak 2024-02-23 01:34:38 +00:00
• 9129d0a252 New ENV Vars alpayariyak 2024-02-22 23:58:20 +00:00
• 6bcd9d7c67 Preparing for 0.3.0 alpayariyak 2024-02-22 18:04:34 -05:00
• b4204c612c Merge pull request #48 from rachfop/patch-1 Alpay AriyakandGitHub 2024-02-21 23:55:11 -05:00