Support vllm - #6

Open

sunildkumar wants to merge 3 commits into

new_base_trainerfrom

Commits on Feb 16, 2025

support verified through init. no changes necessary. Just added some clarifiying prints and verified the constructor works without errors.
sunildkumar
committed
2417f21
update move_model_to_vllm
sunildkumar
committed
4cc5c10
single gpu seems to work until it OOMs.
sunildkumar
committed
83ba6ed