Commit Graph

Select branches

Hide Pull Requests

main

0.1.0

0.2.0

0.2.1

0.2.2

0.2.3

0.3.0

0.3.1

0.3.2

1.0.0

1.0.1

v.2.15.0

v.2.16.0

v.2.2.1

v1.1

v1.2.0

v1.3.0

v1.3.1

v1.4.0

v1.5.0

v1.6.0

v1.7.0

v1.8.0

v1.9.0

v2.1.0

v2.10.0

v2.11.0

v2.11.1

v2.11.2

v2.11.3

v2.12.0

v2.12.1

v2.12.2

v2.12.3

v2.13.0

v2.13.1

v2.14.0

v2.17.0

v2.18.0

v2.18.1

v2.19.0

v2.19.1

v2.19.2

v2.2.0

v2.2.2

v2.20.0

v2.20.1

v2.21.1

v2.22.0

v2.22.1

v2.22.2

v2.22.3

v2.22.4

v2.22.5

v2.23.0

v2.3.0

v2.3.1

v2.3.2

v2.4.0

v2.5.0

v2.5.1

v2.6.0

v2.8.0

v2.9.0

v2.9.1

v2.9.2

v2.9.3

v2.9.4

v2.9.5

v2.9.6

Mono Color

• 7993818f5f Update README.md Patrick RachfordandGitHub 2024-02-21 19:28:03 -08:00
• e97917cc14 Fixes import statement Patrick RachfordandGitHub 2024-02-21 19:17:23 -08:00
• 3549cf24d5 Merge branch 'main' into openai-sse-output Alpay AriyakandGitHub 2024-02-21 19:56:55 -05:00
• aed0408f19 Documentation for 0.3.0, small fixes and changes alpayariyak 2024-02-22 00:24:11 +00:00
• e191149259 OpenAI Compatibility, Dynamic Batching, Refactor alpayariyak 2024-02-21 04:36:04 +00:00
• 2941db0fb8 Update worker-vllm version 0.2.3 Alpay AriyakandGitHub 2024-02-09 23:12:29 -05:00
• bfeb60c54e Merge pull request #45 from willsamu/fix-tokenizer-input Alpay AriyakandGitHub 2024-02-09 22:51:18 -05:00
• 7b3fd05542 Small refactor to tokenizer fix alpayariyak 2024-02-09 22:49:17 -05:00
• b0e7b575f3 fix: default value for tokenizer Samuel Will 2024-02-09 10:24:58 +00:00
• 4f5e0d37c4 Fix tokenizer's trust_remote_code parameter alpayariyak 2024-02-08 23:53:13 +00:00
• a94ef66f71 Dynamic Batch Size [needs refactor] alpayariyak 2024-02-06 03:47:27 +00:00
• 45081e4037 Add __init__.py alpayariyak 2024-02-06 02:44:35 +00:00
• fef8c81cb9 OpenAI Compatible worker, Refactor alpayariyak 2024-02-06 02:44:14 +00:00
• 15b06bb687 Merge branch 'main' into openai-sse-output alpayariyak 2024-02-02 20:03:29 -05:00
• 2b5b8dfb61 Fix Model and Tokenizer download for bake-in option, add revision configuration for both. Alpay AriyakandGitHub 2024-02-02 19:58:50 -05:00
• 8de10468dd Working tokenizer and model download fix alpayariyak 2024-02-03 00:28:21 +00:00
• b7051d37ca Move test_openai_stream.py alpayariyak 2024-02-02 22:12:26 +00:00
• b1720a154d Added download of model extras into weights folder, separate download of tokenizer, making engine.py utilize downloaded tokenizer, model and tokenizer revision alpayariyak 2024-01-31 22:57:32 -05:00
• afa33a2875 Handle errors alpayariyak 2024-02-01 03:01:51 +00:00
• 068303ce8f OpenAI Proxy Server for EndPoints and more examples alpayariyak 2024-02-01 02:32:32 +00:00
• 3bbcf0021b Fix: Yield if tokens left in batch Temp: default model for testing image alpayariyak 2024-02-01 00:52:39 +00:00
• dab8bad906 OpenAI Chat Completions Stream alpayariyak 2024-01-31 23:27:31 +00:00
• f4d7c75504 Snapshot download only tokenizer/config related things Casper 2024-01-31 22:16:44 +01:00
• 3adc9e3336 Remove unused import Casper 2024-01-31 18:27:49 +01:00
• fd00a1ece3 Update to use snapshot_download Casper 2024-01-31 18:24:57 +01:00
• 664dd35782 Download tokenizer upon build Casper 2024-01-31 17:59:52 +01:00
• 370698442c Update RunPod SDK version and Docker Tag alpayariyak 2024-01-31 05:36:50 +00:00
• 3e2cd080a2 Fix Tensor Parallel 0.2.2 alpayariyak 2024-01-31 05:12:58 +00:00
• e7b340d73b Update vLLM base image alpayariyak 2024-01-31 03:37:55 +00:00
• 46eee12819 Simplify Tensor Parallel alpayariyak 2024-01-31 03:28:02 +00:00
• 12d6f0778e Fixed Model bake-in, added Custom Chat Templates, Custom Tokenizer alpayariyak 2024-01-31 03:13:21 +00:00
• fa5556434c Bug fix Alpay AriyakandGitHub 2024-01-29 11:26:22 -05:00
• 97726372c0 Update release tag in README.md alpayariyak 2024-01-25 23:37:07 -05:00
• 9fc8e1e54c Non-streaming OpenAI Chat Completions 0.2.1 alpayariyak 2024-01-26 04:05:05 +00:00
• 4cebe66b36 0.2.0 Release 0.2.0 alpayariyak 2024-01-25 20:35:20 -05:00
• 368c5f87fb Temporary Dockerfile Fix Alpay Ariyakandalpayariyak 2024-01-24 11:47:08 -05:00
• 15cc7cd36f Updated Documentation alpayariyak 2024-01-19 15:40:43 +00:00
• ef3c303743 Added support for n parameter alpayariyak 2024-01-19 15:34:25 +00:00
• 584852f0f6 Docker-Protected HF Token, Refactor, Better Documentation alpayariyak 2024-01-17 18:24:09 +00:00
• 65454c024a Update README.md (temporary) Alpay AriyakandGitHub 2024-01-17 00:16:56 -05:00
• f023e2e097 Update README.md Justin Merrell 2024-01-16 19:55:20 -05:00
• ed48093792 bug fix 0.1.0 Alpay AriyakandGitHub 2024-01-16 18:38:26 -05:00
• a5dc8b53b7 Fix Concurrency, Add Max Model Length alpayariyak 2024-01-16 17:58:46 -05:00
• 6e7a1953e4 fix: update runpod package Justin Merrell 2024-01-12 09:26:08 -05:00
• 23ff046586 Update README.md Alpay AriyakandGitHub 2024-01-11 12:48:54 +07:00
• 914caaa374 Merge branch 'refactor' alpayariyak 2024-01-05 23:44:59 +07:00
• 618dd8e0c4 Temporarily remove examples alpayariyak 2024-01-05 16:44:12 +00:00
• 3e08a69291 Documentation alpayariyak 2024-01-05 16:40:52 +00:00
• fa358708bc Return finish status alpayariyak 2023-12-29 09:08:51 +00:00
• e23ab549e4 Small fix alpayariyak 2023-12-29 08:44:54 +00:00
• a14c5cd388 New Worker Stable alpayariyak 2023-12-29 08:21:09 +00:00
• 2475cd7a66 Local development, disable log requests alpayariyak 2023-12-29 02:21:24 +00:00
• cdda5edab3 Bump runpod version alpayariyak 2023-12-29 02:18:07 +00:00
• ca8b02e392 Concurrency and Prompt Template fix alpayariyak 2023-12-29 00:42:40 +00:00
• 4a6bf9f0ee Concurrency hotfix Alpay AriyakandGitHub 2023-12-28 19:03:46 -05:00
• a69ab1875d vLLM job tracker, Refactor Concurrency Modifier, Serverless Config alpayariyak 2023-12-28 23:06:49 +00:00
• f7ac60f802 Fix Concurrency alpayariyak 2023-12-28 22:56:44 +00:00
• a247a3afe1 Update README.md Alpay AriyakandGitHub 2023-12-22 03:16:04 -05:00
• fe6e618692 Refactor code and Black formatting style alpayariyak 2023-12-22 04:08:55 +00:00
• 1fc64fef2b Additional Examples and Documentation for Chat Template and Messages list alpayariyak 2023-12-21 00:38:14 +00:00
• 38c48c2423 Chat Template Feature, Message List, Small Refactor Alpay AriyakandGitHub 2023-12-20 19:24:29 -05:00
• 3f413c1038 Documentation for Chat Templates, Messages format, Refactor Streaming, etc alpayariyak 2023-12-21 00:22:23 +00:00
• ba893ed148 Refactor prompt handling in handler.py alpayariyak 2023-12-20 18:40:43 -05:00
• 582e21f97f Chat Template alpayariyak 2023-12-20 18:37:54 -05:00
• dad02e13d8 vLLM 0.2.6 Stable Worker alpayariyak 2023-12-20 23:06:57 +00:00
• e4e3ce4a6e Small fix alpayariyak 2023-12-20 08:45:48 +00:00
• c59038e902 Fixed CUDA 11.8 workers alpayariyak 2023-12-20 07:50:14 +00:00
• 210e513f96 Update Dockerfile Alpay AriyakandGitHub 2023-12-19 00:59:24 -05:00
• c321d828ab Update Dockerfile Alpay AriyakandGitHub 2023-12-19 00:58:45 -05:00
• 8a11a7e4ed Add version alpayariyak 2023-12-19 02:57:06 +00:00
• 8202d4cc63 Bug fix alpayariyak 2023-12-19 02:56:21 +00:00
• f324bef8a0 Bump to vLLM 0.2.6, fixes and improvements alpayariyak 2023-12-19 01:52:55 +00:00
• d6c145bc1e Update README.md Alpay AriyakandGitHub 2023-12-18 20:08:35 -05:00
• 840d5ff0d2 Update README.md Alpay AriyakandGitHub 2023-12-16 01:30:49 -05:00
• 6366dac221 Merge pull request #20 from runpod-workers/update-actions Justin MerrellandGitHub 2023-12-14 16:31:00 -05:00
• 06660fb8b9 fix: update badge Justin Merrell 2023-12-14 16:26:52 -05:00
• eaa0e86aa1 Merge pull request #19 from runpod-workers/runpod-package-update Justin MerrellandGitHub 2023-12-14 16:08:32 -05:00
• 15d9de0e10 Update package version justinmerrellandGitHub 2023-12-14 21:07:42 +00:00
• f8484ecfe8 Merge pull request #18 from runpod-workers/merge-ready Justin MerrellandGitHub 2023-12-14 16:07:29 -05:00
• d39844ac00 Small fixes alpayariyak 2023-12-13 13:50:36 +00:00
• bfa3703d54 Concurrency modifier alpayariyak 2023-12-13 12:26:01 +00:00
• 22de0b322d Complete refactor, improved overall functionality alpayariyak 2023-12-13 10:33:03 +00:00
• ef89868570 Small changes alpayariyak 2023-12-12 20:42:27 +00:00
• 91c47790a6 Merge branch 'merge-ready' of https://github.com/runpod-workers/worker-vllm into merge-ready alpayariyak 2023-12-12 20:40:34 +00:00
• 2dbab5c254 Update README.md Alpay AriyakandGitHub 2023-12-12 15:34:47 -05:00
• 50f06a5761 Update README.md Alpay AriyakandGitHub 2023-12-12 14:22:25 -05:00
• 7ca8ee7595 Update README.md Alpay AriyakandGitHub 2023-12-12 14:09:33 -05:00
• e81007d79b bug fix alpayariyak 2023-12-09 19:05:44 +00:00
• b51827388c bug fix alpayariyak 2023-12-09 19:05:44 +00:00
• 8578581c6a Small changes alpayariyak 2023-12-09 18:50:00 +00:00
• f1afbcbe4f CPU Limit alpayariyak 2023-12-09 18:47:45 +00:00
• 5e38a1a2fa Multi-GPU Fix alpayariyak 2023-12-09 10:36:26 +00:00
• bcf37e7bd2 Update Dockerfile Justin Merrell 2023-12-08 20:42:15 -05:00
• deb6f67a25 Update Dockerfile Justin Merrell 2023-12-08 20:42:05 -05:00
• 11e6495304 Update Dockerfile Justin Merrell 2023-12-08 20:28:44 -05:00
• 35a74475f2 Update Dockerfile Justin Merrell 2023-12-08 20:23:23 -05:00
• 4052a17af1 Merge branch 'merge-ready' of https://github.com/runpod-workers/worker-vllm into merge-ready alpayariyak 2023-12-08 10:29:36 +00:00
• 8156b1d8e0 Final changes alpayariyak 2023-12-08 10:29:24 +00:00
• 09a85ca360 feat: add docker build action Justin Merrell 2023-12-08 04:38:29 -05:00
• 5acbbf5528 Cleanup alpayariyak 2023-12-06 20:57:48 +00:00