owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
220 Commits 1 Branch 69 Tags
91167b873aee57852d4b206c6e0d5ec973fbb15c
Commit Graph
220 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
alpayariyak 584852f0f6 Docker-Protected HF Token, Refactor, Better Documentation 2024-01-18 18:20:51 -05:00
Alpay AriyakandGitHub 65454c024a Update README.md (temporary) 2024-01-17 00:16:56 -05:00
Justin Merrell f023e2e097 Update README.md 2024-01-16 19:55:20 -05:00
Alpay AriyakandGitHub ed48093792 bug fix 0.1.0 2024-01-16 18:38:26 -05:00
alpayariyak a5dc8b53b7 Fix Concurrency, Add Max Model Length 2024-01-16 17:58:46 -05:00
Justin Merrell 6e7a1953e4 fix: update runpod package 2024-01-12 09:26:08 -05:00
Alpay AriyakandGitHub 23ff046586 Update README.md 2024-01-11 12:48:54 +07:00
alpayariyak 914caaa374 Merge branch 'refactor' 2024-01-05 23:44:59 +07:00
alpayariyak 618dd8e0c4 Temporarily remove examples 2024-01-05 16:44:12 +00:00
alpayariyak 3e08a69291 Documentation 2024-01-05 16:40:52 +00:00
alpayariyak fa358708bc Return finish status 2023-12-29 09:08:51 +00:00
alpayariyak e23ab549e4 Small fix 2023-12-29 08:44:54 +00:00
alpayariyak a14c5cd388 New Worker Stable 2023-12-29 08:21:09 +00:00
alpayariyak 2475cd7a66 Local development, disable log requests 2023-12-29 02:21:24 +00:00
alpayariyak cdda5edab3 Bump runpod version 2023-12-29 02:18:07 +00:00
alpayariyak ca8b02e392 Concurrency and Prompt Template fix 2023-12-29 00:42:40 +00:00
Alpay AriyakandGitHub 4a6bf9f0ee Concurrency hotfix 2023-12-28 19:03:46 -05:00
alpayariyak a69ab1875d vLLM job tracker, Refactor Concurrency Modifier, Serverless Config 2023-12-28 23:06:49 +00:00
alpayariyak f7ac60f802 Fix Concurrency 2023-12-28 22:56:44 +00:00
Alpay AriyakandGitHub a247a3afe1 Update README.md 2023-12-22 03:16:04 -05:00
alpayariyak fe6e618692 Refactor code and Black formatting style 2023-12-22 04:08:55 +00:00
alpayariyak 1fc64fef2b Additional Examples and Documentation for Chat Template and Messages list 2023-12-21 00:38:14 +00:00
Alpay AriyakandGitHub 38c48c2423 Chat Template Feature, Message List, Small Refactor 
Chat Template Feature, Message List, Small Refactor
 2023-12-20 19:24:29 -05:00
alpayariyak 3f413c1038 Documentation for Chat Templates, Messages format, Refactor Streaming, etc 2023-12-21 00:22:23 +00:00
alpayariyak ba893ed148 Refactor prompt handling in handler.py 2023-12-20 18:40:43 -05:00
alpayariyak 582e21f97f Chat Template 2023-12-20 18:37:54 -05:00
alpayariyak dad02e13d8 vLLM 0.2.6 Stable Worker 2023-12-20 23:06:57 +00:00
alpayariyak e4e3ce4a6e Small fix 2023-12-20 08:45:48 +00:00
alpayariyak c59038e902 Fixed CUDA 11.8 workers 2023-12-20 07:50:14 +00:00
Alpay AriyakandGitHub 210e513f96 Update Dockerfile 2023-12-19 00:59:24 -05:00
Alpay AriyakandGitHub c321d828ab Update Dockerfile 2023-12-19 00:58:45 -05:00
alpayariyak 8a11a7e4ed Add version 2023-12-19 02:57:06 +00:00
alpayariyak 8202d4cc63 Bug fix 2023-12-19 02:56:21 +00:00
alpayariyak f324bef8a0 Bump to vLLM 0.2.6, fixes and improvements 2023-12-19 01:52:55 +00:00
Alpay AriyakandGitHub d6c145bc1e Update README.md 2023-12-18 20:08:35 -05:00
Alpay AriyakandGitHub 840d5ff0d2 Update README.md 2023-12-16 01:30:49 -05:00
Justin MerrellandGitHub 6366dac221 Merge pull request #20 from runpod-workers/update-actions 
fix: update badge
 2023-12-14 16:31:00 -05:00
Justin Merrell 06660fb8b9 fix: update badge 2023-12-14 16:26:52 -05:00
Justin MerrellandGitHub eaa0e86aa1 Merge pull request #19 from runpod-workers/runpod-package-update 
Update runpod package version
 2023-12-14 16:08:32 -05:00
justinmerrellandGitHub 15d9de0e10 Update package version 2023-12-14 21:07:42 +00:00
Justin MerrellandGitHub f8484ecfe8 Merge pull request #18 from runpod-workers/merge-ready 
10x Faster New Worker
 2023-12-14 16:07:29 -05:00
alpayariyak d39844ac00 Small fixes 2023-12-13 13:50:36 +00:00
alpayariyak bfa3703d54 Concurrency modifier 2023-12-13 12:26:01 +00:00
alpayariyak 22de0b322d Complete refactor, improved overall functionality 2023-12-13 10:33:03 +00:00
alpayariyak ef89868570 Small changes 2023-12-12 20:42:27 +00:00
alpayariyak 91c47790a6 Merge branch 'merge-ready' of https://github.com/runpod-workers/worker-vllm into merge-ready 2023-12-12 20:40:34 +00:00
Alpay AriyakandGitHub 2dbab5c254 Update README.md 2023-12-12 15:34:47 -05:00
Alpay AriyakandGitHub 50f06a5761 Update README.md 2023-12-12 14:22:25 -05:00
Alpay AriyakandGitHub 7ca8ee7595 Update README.md 2023-12-12 14:09:33 -05:00
alpayariyak e81007d79b bug fix 2023-12-09 11:10:29 -08:00