 Mo KingandGitHub
|
e9d13c155e
|
Update README.md to fix table of contents links to environment variable sections
Separates environment variables into multiple tables, so that the table of contents will correctly jump to the appropriate section when clicked.
|
2025-04-30 12:45:54 -04:00 |
|
|
pandyamarut
|
f33e8d2bcd
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-21 13:14:32 -07:00 |
|
|
Marut PandyaandGitHub
|
6b64bb93bd
|
Merge pull request #147 from mohamednaji7/BitsAndBytes
completing the "bitsandbytes" option - based on https://docs.vllm.ai/en/stable/quantization/bnb.html
|
2025-04-21 11:39:53 -07:00 |
|
|
pandyamarut
|
3d067cd472
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-07 11:54:57 -07:00 |
|
|
pandyamarut
|
acbdf63de8
|
update vllm 0.8.2
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-26 15:55:30 -07:00 |
|
|
Hailong YangandGitHub
|
fa31d9663d
|
Update README.md
|
2025-03-11 22:24:22 -04:00 |
|
|
Marut PandyaandGitHub
|
dc6f3239bd
|
Update README.md
|
2025-02-24 18:39:14 -08:00 |
|
|
pandyamarut
|
c9791f1163
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-11 13:27:57 -08:00 |
|
|
Mohamed NagyandGitHub
|
04288240f6
|
updating the . in ['awq', 'squeezellm', 'gptq'. 'bitsandbytes'] for the QUNATIZATION row
|
2025-02-02 14:58:48 +02:00 |
|
|
pandyamarut
|
91ed30e9a2
|
update readme
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:21:33 -08:00 |
|
|
mohamednaji7
|
8882f6d50b
|
adding 'bitsandbytes' to QUANTIZATION
|
2025-01-21 14:46:40 +02:00 |
|
|
pandyamarut
|
06c2bb1715
|
upgrade vllm version
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-12-30 15:20:11 -08:00 |
|
|
Marut PandyaandGitHub
|
d9f54ce76a
|
Update README.md
|
2024-11-29 16:30:45 -08:00 |
|
|
Marut PandyaandGitHub
|
94840cfbbb
|
Update README.md
|
2024-10-15 17:38:31 -07:00 |
|
|
Dean QuiñanolaandGitHub
|
c28aa02576
|
Update README.md
v1.5.0 not v15
|
2024-10-12 17:11:59 -07:00 |
|
|
Marut PandyaandGitHub
|
251e807012
|
Update README.md
|
2024-10-01 11:17:30 -07:00 |
|
|
pandyamarut
|
cc301ac123
|
update
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-16 15:00:01 -07:00 |
|
|
pandyamarut
|
2ac6a0108f
|
update vllm v0.6.0
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-16 14:55:40 -07:00 |
|
|
pandyamarut
|
3dad3a754c
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-06 12:21:34 -07:00 |
|
|
Marut PandyaandGitHub
|
cdf78e7c89
|
Update README.md
|
2024-08-28 23:32:36 -07:00 |
|
|
pandyamarut
|
3293245c81
|
update tags
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-28 23:28:39 -07:00 |
|
|
Marut PandyaandGitHub
|
286d6ba702
|
Merge pull request #102 from carlson-svg/main
Add human readable worker-config.json
|
2024-08-26 20:22:47 -07:00 |
|
|
carlson-svg
|
4fa4a8e0e6
|
added to worker config docs to table of contents + added side note
|
2024-08-26 01:20:18 -07:00 |
|
|
Marut PandyaandGitHub
|
2111c9e7a5
|
Update README.md
|
2024-08-12 21:02:43 -07:00 |
|
|
Marut PandyaandGitHub
|
571ef2b805
|
Update README.md
|
2024-08-09 14:58:46 -07:00 |
|
|
pandyamarut
|
967eaba573
|
change to float
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-09 14:41:07 -07:00 |
|
|
Marut PandyaandGitHub
|
f023f57217
|
Update README.md
|
2024-08-07 15:38:26 -07:00 |
|
|
Marut PandyaandGitHub
|
673597fd46
|
Update README.md
|
2024-08-07 15:32:23 -07:00 |
|
|
Marut PandyaandGitHub
|
c50543ebd9
|
Update README.md
|
2024-08-07 15:30:33 -07:00 |
|
|
pandyamarut
|
3498e99b2f
|
update
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-05 14:33:56 -07:00 |
|
|
pandyamarut
|
5da96ce9a6
|
update
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-05 14:26:56 -07:00 |
|
|
Marut PandyaandGitHub
|
e32626ca9d
|
Update README.md
|
2024-08-05 14:19:38 -07:00 |
|
|
pandyamarut
|
e846ecae9d
|
update readme
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-02 14:13:55 -07:00 |
|
|
Marut PandyaandGitHub
|
9f066be620
|
Update README.md
|
2024-08-02 13:29:18 -07:00 |
|
|
Marut PandyaandGitHub
|
e1b41795f7
|
Update README.md
|
2024-07-31 12:46:34 -07:00 |
|
|
Marut PandyaandGitHub
|
0814d76654
|
Update README.md
|
2024-07-30 17:09:01 -07:00 |
|
|
alpayariyak
|
0e1e38326a
|
Fix deprecated max_context_len_to_capture engine argument
|
2024-06-13 17:48:05 +00:00 |
|
|
alpayariyak
|
c8458fef2b
|
preparation for 1.0.0 release
|
2024-06-12 12:28:03 -07:00 |
|
|
|
30cb56a3df
|
Fix MODEL_REVISION env var (Merge pull request #50 from joennlae/rename-revision and #67 from mikljohansson/main)
Fixed MODEL_REVISION environment variable
Co-Authored-By: Jannis Schönleber <1493766+joennlae@users.noreply.github.com>
Co-Authored-By: Mikael Johansson <mikl.johansson@gmail.com>
|
2024-05-09 20:45:07 -04:00 |
|
|
alpayariyak
|
9f2cb7b1d0
|
Update documentation to include rename of fp8_e5m2 to fp8
|
2024-05-09 23:59:11 +00:00 |
|
|
Alpay AriyakandGitHub
|
4f61b04afe
|
Update README.md
|
2024-05-09 01:05:04 -04:00 |
|
|
Alpay Ariyakandalpayariyak
|
874379a0c5
|
1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62)
|
2024-05-09 00:42:08 -04:00 |
|
|
alpayariyak
|
0a5b5bc095
|
Add badges
|
2024-03-15 21:23:52 -04:00 |
|
|
alpayariyak
|
2936e4d95d
|
Update automatic builds, documentation
|
2024-03-15 11:57:38 -04:00 |
|
|
Alpay AriyakandGitHub
|
cee4e484d5
|
Update README.md for 0.3.2
|
2024-03-12 19:07:37 -04:00 |
|
|
alpayariyak
|
db7167d57f
|
0.3.3
|
2024-03-05 19:14:35 +00:00 |
|
|
Alpay Ariyakandalpayariyak
|
d91ccb866f
|
0.3.1: bug fixes
|
2024-02-29 02:55:44 -05:00 |
|
|
Alpay AriyakandGitHub
|
36e9b670ee
|
Add notice on what to do when HuggingFace is down
|
2024-02-28 17:10:39 -05:00 |
|
|
Alpay Ariyakandalpayariyak
|
91167b873a
|
v0.3.0: OpenAI Compatibility, Dynamic Stream Batching, Refactor, Error Catching
|
2024-02-23 22:34:00 -05:00 |
|
|
Alpay AriyakandGitHub
|
6f5718f191
|
Update Docker image tag in README.md
|
2024-02-23 02:15:50 -05:00 |
|