owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
84 Commits 1 Branch 69 Tags
98af83412446a1590ebf7fada708cfc3810ee96a
Commit Graph
84 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Justin Merrell 98af834124 fix: added hf_transfer requirement 2023-11-21 20:50:12 -05:00
Justin Merrell d06fb9ea01 Update Dockerfile 2023-11-21 20:20:15 -05:00
Justin Merrell ff3ed55c9f Update requirements.txt 2023-11-21 20:14:51 -05:00
Justin Merrell cbde2cbf9c Update download_model.py 2023-11-21 20:10:37 -05:00
Justin Merrell 5ca8e56bbe fix: clean up extra 2023-11-21 19:18:08 -05:00
alpayariyak c34d79ea49 Entrypoint for testing 2023-11-20 18:56:00 -05:00
alpayariyak 8f17764f8a Update Dockerfile 2023-11-15 20:55:17 -05:00
alpayariyak e7c8de4678 Changes to worker 2023-11-15 20:53:04 -05:00
Alpay AriyakandGitHub 24feadd903 Update README.md 2023-11-14 19:25:41 -05:00
Samuel Willandalpayariyak 4f792062aa vllm 0.2.1.post1 - speed boost, quantization, mistral support 2023-11-14 19:12:58 -05:00
Jorg Doku 5bccd40952 using vllm 0.1.7 2023-09-21 09:41:59 -05:00
Jorg Doku ba4e6e6df0 fix aggre 2023-09-05 23:51:35 -05:00
Jorg Doku 871196dafb update 2023-09-05 22:06:46 -05:00
Jorg Doku 5e04e5ebb0 print out llm metrics, make metrics more verbose 2023-08-31 19:09:04 -05:00
Jorg Doku 06183813cf take advantage of layering 2023-08-31 18:30:59 -05:00
Jorg Doku 54d229cb16 upate metrics 2023-08-31 18:26:37 -05:00
Jorg Doku 84d6047cbf update 2023-08-31 17:41:39 -05:00
Jorg Doku 96c4d70d2e metrics now included 2023-08-31 17:03:59 -05:00
Jorg Doku c5662663ce update response 2023-08-31 16:00:28 -05:00
Jorg Doku 9f1dd5a9b1 finished 2023-08-31 15:56:13 -05:00
Jorg Doku 9eb099ded2 fix bug 2023-08-31 14:42:18 -05:00
Jorg Doku 460f3dd348 update the handler 2023-08-31 13:48:57 -05:00
Jorg Doku 50689a2caa test 2023-08-30 17:57:46 -05:00
Jorg Doku e73e108193 reduce logs 2023-08-30 12:13:20 -05:00
Jorg Doku be4421e8e2 finalize 2023-08-30 02:33:51 -05:00
Jorg Doku 66056e694c finalize 2023-08-30 01:58:27 -05:00
Jorg Doku 5e4865e708 complete 2023-08-30 00:08:11 -05:00
Jorg Doku 476498b9bc fix metrics 2023-08-29 22:17:50 -05:00
Jorg Doku 5fd458381d win 2023-08-29 21:29:51 -05:00
Jorg Doku 5b112b30c2 update handler 2023-08-29 21:22:01 -05:00
Jorg Doku 244ce53679 fix 2023-08-29 20:41:50 -05:00
Jorg Doku f79c834268 fix 2023-08-29 18:04:19 -05:00
Jorg Doku 73c55b87e4 fix 2023-08-29 17:18:21 -05:00
Jorg Doku 62961ce773 update vllm version 2023-08-29 16:37:24 -05:00
Jorg Doku acb120bf54 improving metrics in worker 2023-08-29 11:07:25 -05:00
Jorg Doku 51d231c37a done 2023-08-25 18:26:28 -05:00
Jorg Doku e3cdd46a99 update 2023-08-25 12:03:43 -05:00
Jorg Doku d6cce5d5b6 update 2023-08-24 15:46:30 -05:00
Jorg Doku 33ab5600bf update 2023-08-24 13:58:38 -05:00
Jorg Doku f4e8c84695 update 2023-08-22 15:44:28 -05:00
Jorg Doku 5dd9555306 update 2023-08-22 15:44:02 -05:00
Jorg Doku 6498c67340 update 2023-08-22 15:40:09 -05:00
Jorg Doku 177c8c57c0 update 2023-08-22 15:36:43 -05:00
Jorg Doku eb1bcdd049 incorporating metrics into the vLLM worker 2023-08-21 17:34:51 -05:00
Jorg Doku 9bf9039151 updating the llm worker 2023-08-18 09:40:02 -05:00
Jorg Doku 3838e54a12 update 2023-08-09 10:42:44 -05:00
Jorg Doku 68a4e3c874 add 2023-08-09 10:39:22 -05:00
Jorg Doku 1976bf19bf Merge remote-tracking branch 'refs/remotes/origin/main' 2023-08-09 10:37:53 -05:00
Jorg Doku 3ab0770b1b including env variable for tensor parallelism / multi-gpu 2023-08-09 10:37:43 -05:00
Jorg DokuandGitHub f8fba87ce6 Merge pull request #4 from vladmihaisima/main 
Fixed STREAMING environment variable not being interpreted as boolean.
 2023-08-08 10:53:20 -05:00