Alpay Ariyakandalpayariyak 874379a0c5 1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62)

2024-05-09 00:42:08 -04:00

..

__init__.py

Add __init__.py

2024-02-06 02:44:35 +00:00

config.py

0.3.3

2024-03-05 19:14:35 +00:00

constants.py

Small refactor

2024-03-06 17:08:57 +00:00

download_model.py

1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62)

2024-05-09 00:42:08 -04:00

engine.py

1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62)

2024-05-09 00:42:08 -04:00

handler.py

OpenAI Compatibility, Dynamic Batching, Refactor

2024-02-21 04:36:04 +00:00

tokenizer.py

Fix Multi-GPU, tokenizer trust remote code

2024-02-24 03:18:25 +00:00

utils.py

1.0.0preview update for Llama 3 support and more (vLLM 0.3.3 -> 0.4.2) (#62)

2024-05-09 00:42:08 -04:00