vLLM 0.23.0 is now available on Cardinal and Ascend. To use, run:
module load vllm/0.23.0
For detailed usage at OSC, see: vLLM software page
See official release notes for features and more details.
vLLM 0.23.0 is now available on Cardinal and Ascend. To use, run:
module load vllm/0.23.0
For detailed usage at OSC, see: vLLM software page
See official release notes for features and more details.