 alpayariyak
|
5bd6f3a75e
|
0.5.3, any vllm arg as env var, refactor and fixes, moving away from building separate image from vLLM fork
|
2024-07-25 12:41:48 -07:00 |
|
|
alpayariyak
|
f19ce12ab0
|
Fix Building Docker with model built-in #71
|
2024-06-07 15:29:46 -07:00 |
|
|
Alpay Ariyakandalpayariyak
|
874379a0c5
|
1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62)
|
2024-05-09 00:42:08 -04:00 |
|
|
alpayariyak
|
8de10468dd
|
Working tokenizer and model download fix
Fix handler startup
|
2024-02-02 19:55:35 -05:00 |
|
|
alpayariyak
|
b1720a154d
|
Added download of model extras into weights folder, separate download of tokenizer, making engine.py utilize downloaded tokenizer, model and tokenizer revision
|
2024-01-31 22:57:32 -05:00 |
|
|
Casper
|
f4d7c75504
|
Snapshot download only tokenizer/config related things
|
2024-01-31 22:16:44 +01:00 |
|
|
Casper
|
3adc9e3336
|
Remove unused import
|
2024-01-31 18:27:49 +01:00 |
|
|
Casper
|
fd00a1ece3
|
Update to use snapshot_download
|
2024-01-31 18:24:57 +01:00 |
|
|
Casper
|
664dd35782
|
Download tokenizer upon build
|
2024-01-31 17:59:52 +01:00 |
|
|
alpayariyak
|
12d6f0778e
|
Fixed Model bake-in, added Custom Chat Templates, Custom Tokenizer
|
2024-01-31 03:13:21 +00:00 |
|
|
alpayariyak
|
fe6e618692
|
Refactor code and Black formatting style
|
2023-12-22 04:08:55 +00:00 |
|
|
alpayariyak
|
c59038e902
|
Fixed CUDA 11.8 workers
|
2023-12-20 07:50:14 +00:00 |
|
|
alpayariyak
|
b705544bd4
|
model packing, cuda version selection on build
|
2023-12-06 18:52:21 +00:00 |
|
|
alpayariyak
|
66c23d45b0
|
Model Downloading, no GPU
|
2023-12-06 01:43:09 +00:00 |
|
|
alpayariyak
|
b4c61e61c4
|
Packing model into worker for internal use
|
2023-12-05 20:26:56 -05:00 |
|
|
alpayariyak
|
820a21f32c
|
Download logic + other changes
|
2023-11-28 19:15:08 -05:00 |
|
|
alpayariyak
|
97480ff0ae
|
handler changes
|
2023-11-28 23:39:48 +00:00 |
|
|
Justin Merrell
|
cbde2cbf9c
|
Update download_model.py
|
2023-11-21 20:10:37 -05:00 |
|
|
Justin Merrell
|
5ca8e56bbe
|
fix: clean up extra
|
2023-11-21 19:18:08 -05:00 |
|
|
Jorg Doku
|
401a4637fa
|
latest version
|
2023-08-03 10:05:51 -05:00 |
|
|
Jorg Doku
|
b78a3d4429
|
update
|
2023-07-31 14:01:38 -05:00 |
|
|
Jorg Doku
|
9fe114c049
|
llama 2
|
2023-07-20 18:45:08 -05:00 |
|