owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
142 Commits 1 Branch 69 Tags
c59038e90224f6712ccae5338bf4ac8b656a472c
Commit Graph
142 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
alpayariyak c59038e902 Fixed CUDA 11.8 workers 2023-12-20 07:50:14 +00:00
Alpay AriyakandGitHub 210e513f96 Update Dockerfile 2023-12-19 00:59:24 -05:00
Alpay AriyakandGitHub c321d828ab Update Dockerfile 2023-12-19 00:58:45 -05:00
alpayariyak 8a11a7e4ed Add version 2023-12-19 02:57:06 +00:00
alpayariyak 8202d4cc63 Bug fix 2023-12-19 02:56:21 +00:00
alpayariyak f324bef8a0 Bump to vLLM 0.2.6, fixes and improvements 2023-12-19 01:52:55 +00:00
Alpay AriyakandGitHub d6c145bc1e Update README.md 2023-12-18 20:08:35 -05:00
Alpay AriyakandGitHub 840d5ff0d2 Update README.md 2023-12-16 01:30:49 -05:00
Justin MerrellandGitHub 6366dac221 Merge pull request #20 from runpod-workers/update-actions 
fix: update badge
 2023-12-14 16:31:00 -05:00
Justin Merrell 06660fb8b9 fix: update badge 2023-12-14 16:26:52 -05:00
Justin MerrellandGitHub eaa0e86aa1 Merge pull request #19 from runpod-workers/runpod-package-update 
Update runpod package version
 2023-12-14 16:08:32 -05:00
justinmerrellandGitHub 15d9de0e10 Update package version 2023-12-14 21:07:42 +00:00
Justin MerrellandGitHub f8484ecfe8 Merge pull request #18 from runpod-workers/merge-ready 
10x Faster New Worker
 2023-12-14 16:07:29 -05:00
alpayariyak d39844ac00 Small fixes 2023-12-13 13:50:36 +00:00
alpayariyak bfa3703d54 Concurrency modifier 2023-12-13 12:26:01 +00:00
alpayariyak 22de0b322d Complete refactor, improved overall functionality 2023-12-13 10:33:03 +00:00
alpayariyak ef89868570 Small changes 2023-12-12 20:42:27 +00:00
alpayariyak 91c47790a6 Merge branch 'merge-ready' of https://github.com/runpod-workers/worker-vllm into merge-ready 2023-12-12 20:40:34 +00:00
Alpay AriyakandGitHub 2dbab5c254 Update README.md 2023-12-12 15:34:47 -05:00
Alpay AriyakandGitHub 50f06a5761 Update README.md 2023-12-12 14:22:25 -05:00
Alpay AriyakandGitHub 7ca8ee7595 Update README.md 2023-12-12 14:09:33 -05:00
alpayariyak e81007d79b bug fix 2023-12-09 11:10:29 -08:00
alpayariyak b51827388c bug fix 2023-12-09 19:06:41 +00:00
alpayariyak 8578581c6a Small changes 2023-12-09 18:50:00 +00:00
alpayariyak f1afbcbe4f CPU Limit 2023-12-09 18:47:45 +00:00
alpayariyak 5e38a1a2fa Multi-GPU Fix 2023-12-09 10:36:26 +00:00
Justin Merrell bcf37e7bd2 Update Dockerfile 2023-12-08 20:42:15 -05:00
Justin Merrell deb6f67a25 Update Dockerfile 2023-12-08 20:42:05 -05:00
Justin Merrell 11e6495304 Update Dockerfile 2023-12-08 20:28:44 -05:00
Justin Merrell 35a74475f2 Update Dockerfile 2023-12-08 20:23:23 -05:00
alpayariyak 4052a17af1 Merge branch 'merge-ready' of https://github.com/runpod-workers/worker-vllm into merge-ready 2023-12-08 10:29:36 +00:00
alpayariyak 8156b1d8e0 Final changes 2023-12-08 10:29:24 +00:00
Justin Merrell 09a85ca360 feat: add docker build action 2023-12-08 04:38:29 -05:00
alpayariyak 5acbbf5528 Cleanup 2023-12-06 20:57:48 +00:00
alpayariyak 8dbd8f15dd Token counting, cuda-related changes 2023-12-06 19:02:12 +00:00
alpayariyak b705544bd4 model packing, cuda version selection on build 2023-12-06 18:52:21 +00:00
alpayariyak 48c520b240 Version Bump + small changes 2023-12-06 16:48:12 +00:00
alpayariyak 66c23d45b0 Model Downloading, no GPU 2023-12-06 01:43:09 +00:00
alpayariyak b4c61e61c4 Packing model into worker for internal use 2023-12-05 20:26:56 -05:00
alpayariyak 3a9393bafd Batched Tokens, cleanup 2023-12-05 17:46:28 +00:00
alpayariyak 8d27261645 Logging change 2023-12-01 10:18:48 +00:00
alpayariyak b242b0cedd Refactor handler + add non-streaming, add utils.py 2023-12-01 10:12:56 +00:00
alpayariyak daf2f4d07b Make handler stream aggregate_text 2023-12-01 04:21:03 +00:00
Justin Merrell 8dbf197362 Update handler.py 2023-11-30 11:00:16 -05:00
alpayariyak 86916bf628 Update handler.py 2023-11-29 23:37:17 -05:00
Justin Merrell f958014d10 Update handler.py 2023-11-29 22:41:59 -05:00
Justin Merrell bd3ede60f3 Update Dockerfile 2023-11-29 22:32:30 -05:00
Justin Merrell 4131b7a16d Update Dockerfile 2023-11-29 22:32:13 -05:00
Justin Merrell c455508931 Update handler.py 2023-11-29 22:01:17 -05:00
Justin Merrell 9b9c1cf503 cleanup 2023-11-29 21:32:40 -05:00