owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
47 Commits 1 Branch 69 Tags
d6cce5d5b66061e08a4b0d44db5158ae092e85cd
Commit Graph
47 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jorg Doku d6cce5d5b6 update 2023-08-24 15:46:30 -05:00
Jorg Doku 33ab5600bf update 2023-08-24 13:58:38 -05:00
Jorg Doku f4e8c84695 update 2023-08-22 15:44:28 -05:00
Jorg Doku 5dd9555306 update 2023-08-22 15:44:02 -05:00
Jorg Doku 6498c67340 update 2023-08-22 15:40:09 -05:00
Jorg Doku 177c8c57c0 update 2023-08-22 15:36:43 -05:00
Jorg Doku eb1bcdd049 incorporating metrics into the vLLM worker 2023-08-21 17:34:51 -05:00
Jorg Doku 9bf9039151 updating the llm worker 2023-08-18 09:40:02 -05:00
Jorg Doku 3838e54a12 update 2023-08-09 10:42:44 -05:00
Jorg Doku 68a4e3c874 add 2023-08-09 10:39:22 -05:00
Jorg Doku 1976bf19bf Merge remote-tracking branch 'refs/remotes/origin/main' 2023-08-09 10:37:53 -05:00
Jorg Doku 3ab0770b1b including env variable for tensor parallelism / multi-gpu 2023-08-09 10:37:43 -05:00
Jorg DokuandGitHub f8fba87ce6 Merge pull request #4 from vladmihaisima/main 
Fixed STREAMING environment variable not being interpreted as boolean.
 2023-08-08 10:53:20 -05:00
Vlad-Mihai Sima 58324fed8f Fixed STREAMING environment variable not being interpreted as boolean, when set in environment to 'False'. 2023-08-08 15:01:03 +02:00
Jorg Doku 72be7ff31d update 2023-08-07 11:28:36 -05:00
Jorg Doku fdfe69c717 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-08-06 14:20:00 -05:00
Jorg Doku 4e4d3a27fc fixed 2023-08-06 14:17:53 -05:00
Jorg DokuandGitHub 9e836cc6d1 Update README.md 2023-08-03 10:48:40 -05:00
Jorg DokuandGitHub 04baa8903d Update README.md 2023-08-03 10:45:57 -05:00
Jorg DokuandGitHub 53f9967ea4 Update README.md 2023-08-03 10:45:32 -05:00
Jorg DokuandGitHub 569b3059f0 Update README.md 2023-08-03 10:33:52 -05:00
Jorg DokuandGitHub da05702372 Update README.md 2023-08-03 10:31:56 -05:00
Jorg DokuandGitHub 7b1e0c29d7 Update README.md 2023-08-03 10:30:27 -05:00
Jorg DokuandGitHub 00477f2131 Update README.md 2023-08-03 10:29:14 -05:00
Jorg Doku 401a4637fa latest version 2023-08-03 10:05:51 -05:00
Jorg Doku 728e4f4f2e updating the handler 2023-07-31 14:04:34 -05:00
Jorg Doku b78a3d4429 update 2023-07-31 14:01:38 -05:00
Jorg Doku c862d043dc latest 2023-07-28 23:14:03 -05:00
Jorg Doku 67b6cb8b33 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-07-20 18:45:26 -05:00
Jorg Doku 9fe114c049 llama 2 2023-07-20 18:45:08 -05:00
Jorg DokuandGitHub 9c84810977 Update dev 2023-07-20 08:46:57 -05:00
Jorg Doku ff59fb6b8f this version works! 2023-07-19 09:21:42 -05:00
Jorg Doku 9046fc811b win 2023-07-18 22:04:35 -05:00
Jorg Doku 2c186072d2 updating serverless worker to include http streaming 2023-07-17 16:28:55 -05:00
Jorg Doku 57d7d7b589 update worker 2023-07-17 03:36:07 -05:00
Jorg Doku 56e91ea42a update handler logic 2023-07-14 20:56:58 -05:00
Jorg Doku ab3f0e1c58 update worker 2023-07-14 11:17:25 -05:00
Jorg Doku be65b7a99c update the worker 2023-07-14 00:46:14 -05:00
Jorg Doku 488a9a9451 temp 2023-07-05 22:34:26 -05:00
Jorg Doku c91fc100cd push 2023-07-05 22:32:32 -05:00
Jorg Doku 9c141ff30f fix handler & req 2023-07-05 17:16:13 -05:00
Jorg Doku c8ec26a782 update docker container 2023-07-05 15:47:45 -05:00
Jorg Doku 32b163de8c clean name 2023-07-05 13:22:45 -05:00
Jorg Doku 9fe3d4a09d cleaning up handler for users 2023-07-05 13:20:08 -05:00
Jorg Doku 68184d424b testing vllm 2023-07-05 03:51:21 -05:00
Jorg DokuandGitHub c4bebc030d Update README.md 2023-07-03 13:43:09 -05:00
Jorg DokuandGitHub 38829c2720 Initial commit 2023-07-03 13:42:43 -05:00