pandyamarut 967eaba573 change to float ...

Signed-off-by: pandyamarut <pandyamarut@gmail.com>

2024-08-09 14:41:07 -07:00

..

__init__.py

Add __init__.py

2024-02-06 02:44:35 +00:00

constants.py

Small refactor

2024-03-06 17:08:57 +00:00

download_model.py

0.5.3, any vllm arg as env var, refactor and fixes, moving away from building separate image from vLLM fork

2024-07-25 12:41:48 -07:00

engine_args.py

change to float

2024-08-09 14:41:07 -07:00

engine.py

update vllm version 0.5.4

2024-08-09 12:01:42 -07:00

handler.py

OpenAI Compatibility, Dynamic Batching, Refactor

2024-02-21 04:36:04 +00:00

tokenizer.py

0.5.3, any vllm arg as env var, refactor and fixes, moving away from building separate image from vLLM fork

2024-07-25 12:41:48 -07:00

utils.py

0.5.3, any vllm arg as env var, refactor and fixes, moving away from building separate image from vLLM fork

2024-07-25 12:41:48 -07:00