5 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
mohamednaji7	131c17569f	correct access to "args" dictionary	2025-01-21 22:33:28 +02:00
mohamednaji7	8882f6d50b	adding 'bitsandbytes' to QUANTIZATION	2025-01-21 14:46:40 +02:00
mohamednaji7	331bc30101	adding 'bitsandbytes' option	2025-01-21 14:08:37 +02:00
mohamednaji7	a27f72a33a	inforce args.quantization for bnb load_froamt	2025-01-21 14:01:32 +02:00
mohamednaji7	7167985f23	including bitsandbytes "src:https://docs.vllm.ai/en/stable/quantization/bnb.html"	2025-01-21 13:49:36 +02:00