[Bug]: the issues about install vllm with cuda 12.6, Why hasn't anyone answered this question?

[cqray1990]

Your current environment

cuda 12.6
ubuntu 20

Is it possible to install vllm==0.21.0 by compiling the source code?

🐛 Describe the bug

conda activate vllm_env
git clone -b 0.21.0 https://github.com/vllm-project/vllm.git
cd vllm
python use_existing_torch.py
pip install -r requirements/build/cuda.txt
pip install --no-build-isolation -e .

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[Mahnoor-Zaffar]

Hey! Thanks for reporting this.

The most likely root cause of the issue may relate to compatibility between the vllm package and CUDA 12.6. The installation process involves running a script (use_existing_torch.py) and installing dependencies from requirements/build/cuda.txt, which may not be fully compatible with the specified CUDA version.

The relevant files involved in the installation process include:

• requirements/build/cuda.txt
• use_existing_torch.py

To address the issue, it would be reasonable to verify the compatibility of vllm version 0.21.0 with CUDA 12.6 and ensure that the dependencies listed in cuda.txt are appropriate for this version. Additionally, reviewing any installation logs or errors encountered during the process may provide further insights.

If additional information is needed, please clarify if any specific error messages were encountered during the installation.

If no one is currently working on this, I'd be happy to take a look and put together a fix.

[cqray1990]

Hey! Thanks for reporting this.

The most likely root cause of the issue may relate to compatibility between the vllm package and CUDA 12.6. The installation process involves running a script (use_existing_torch.py) and installing dependencies from requirements/build/cuda.txt, which may not be fully compatible with the specified CUDA version.

The relevant files involved in the installation process include:

* `requirements/build/cuda.txt`

* `use_existing_torch.py`

To address the issue, it would be reasonable to verify the compatibility of vllm version 0.21.0 with CUDA 12.6 and ensure that the dependencies listed in cuda.txt are appropriate for this version. Additionally, reviewing any installation logs or errors encountered during the process may provide further insights.

If additional information is needed, please clarify if any specific error messages were encountered during the installation.

If no one is currently working on this, I'd be happy to take a look and put together a fix.

@Mahnoor-Zaffar

the build log as ffollows:
build command: MAX_JOBS=16 python -m pip install --no-build-isolation -e . 2>&1 | tee build.log

Obtaining file:///home/user/vllm
Checking if build backend supports build_editable: started
Checking if build backend supports build_editable: finished with status 'done'
Preparing editable metadata (pyproject.toml): started
Preparing editable metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: regex in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.7.19)
Requirement already satisfied: cachetools in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (7.1.7)
Requirement already satisfied: psutil in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (7.2.2)
Requirement already satisfied: sentencepiece in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.2)
Requirement already satisfied: numpy in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.3.5)
Requirement already satisfied: requests>=2.26.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.34.2)
Requirement already satisfied: tqdm in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.70.0)
Requirement already satisfied: blake3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.0.9)
Requirement already satisfied: py-cpuinfo in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (9.0.0)
Requirement already satisfied: transformers!=5.0.,!=5.1.,!=5.2.,!=5.3.,!=5.4.,!=5.5.0,>=4.56.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (5.10.4)
Requirement already satisfied: tokenizers>=0.21.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.22.2)
Requirement already satisfied: safetensors>=0.6.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.0)
Requirement already satisfied: protobuf!=6.30.,!=6.31.,!=6.32.,!=6.33.0.,!=6.33.1.,!=6.33.2.,!=6.33.3.,!=6.33.4.,>=5.29.6 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (7.35.1)
Collecting fastapi<0.137,>=0.115.0 (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached fastapi-0.136.3-py3-none-any.whl.metadata (27 kB)
Requirement already satisfied: aiohttp>=3.13.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.14.3)
Requirement already satisfied: openai>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.0.0)
Requirement already satisfied: pydantic>=2.12.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.13.4)
Requirement already satisfied: prometheus_client>=0.18.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.26.0)
Requirement already satisfied: pillow in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.2.0)
Requirement already satisfied: prometheus-fastapi-instrumentator>=7.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (8.1.0)
Requirement already satisfied: tiktoken>=0.6.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.13.0)
Requirement already satisfied: lm-format-enforcer==0.11.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.11.3)
Collecting llguidance<1.8.0,>=1.7.0 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached llguidance-1.7.6-cp39-abi3-manylinux_2_31_x86_64.whl.metadata (10 kB)
Requirement already satisfied: outlines_core==0.2.14 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.14)
Requirement already satisfied: diskcache==5.6.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (5.6.3)
Requirement already satisfied: lark==1.2.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.2)
Requirement already satisfied: xgrammar<1.0.0,>=0.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.3)
Requirement already satisfied: typing_extensions>=4.10 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.15.0)
Requirement already satisfied: filelock>=3.16.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.29.0)
Requirement already satisfied: partial-json-parser in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.1.1.post7)
Requirement already satisfied: pyzmq>=25.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (27.1.0)
Requirement already satisfied: msgspec in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.21.1)
Requirement already satisfied: gguf>=0.17.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.19.0)
Requirement already satisfied: mistral_common>=1.11.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.11.7)
Requirement already satisfied: opencv-python-headless>=4.13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (5.0.0.93)
Requirement already satisfied: pyyaml in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (6.0.3)
Requirement already satisfied: six>=1.16.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.17.0)
Requirement already satisfied: setuptools<81.0.0,>=77.0.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (78.1.0)
Requirement already satisfied: einops in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.2)
Collecting compressed-tensors==0.17.0 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached compressed_tensors-0.17.0-py3-none-any.whl.metadata (4.7 kB)
Requirement already satisfied: depyf==0.20.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.20.0)
Requirement already satisfied: cloudpickle in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.1.2)
Requirement already satisfied: watchfiles in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.0)
Requirement already satisfied: python-json-logger in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.1.0)
Requirement already satisfied: ninja in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.13.0)
Requirement already satisfied: pybase64 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.5.0)
Requirement already satisfied: cbor2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (6.1.4)
Requirement already satisfied: ijson in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.5.1)
Requirement already satisfied: setproctitle in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.3.7)
Requirement already satisfied: openai-harmony>=0.0.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.8)
Requirement already satisfied: anthropic>=0.71.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.122.0)
Requirement already satisfied: model-hosting-container-standards<1.0.0,>=0.1.14 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.16)
Requirement already satisfied: mcp in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.0.0)
Requirement already satisfied: opentelemetry-sdk>=1.27.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-api>=1.27.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-exporter-otlp>=1.27.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-semantic-conventions-ai>=0.4.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.5.1)
Requirement already satisfied: numba==0.65.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.65.0)
Collecting flashinfer-python==0.6.12 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached flashinfer_python-0.6.12-py3-none-any.whl.metadata (11 kB)
Collecting flashinfer-cubin==0.6.12 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached flashinfer_cubin-0.6.12-py3-none-any.whl.metadata (1.3 kB)
Requirement already satisfied: apache-tvm-ffi==0.1.9 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.9)
Requirement already satisfied: tilelang==0.1.9 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.9)
Collecting nvidia-cudnn-frontend>=1.19.1 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cudnn_frontend-1.27.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (16 kB)
Requirement already satisfied: fastsafetensors>=0.3.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.3.3)
Collecting nvidia-cutlass-dsl==4.5.2 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cutlass_dsl-4.5.2-py3-none-any.whl.metadata (2.8 kB)
Requirement already satisfied: quack-kernels>=0.3.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.4.1)
Requirement already satisfied: tokenspeed-mla==0.1.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.2)
Collecting humming-kernels==0.1.4 (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached humming_kernels-0.1.4-py3-none-any.whl.metadata (4.1 kB)
Requirement already satisfied: torch>=2.10.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.11.0+cu126)
Requirement already satisfied: loguru in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.7.3)
Requirement already satisfied: astor in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from depyf==0.20.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.1)
Requirement already satisfied: dill in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from depyf==0.20.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.4.1)
Requirement already satisfied: click in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (8.4.2)
Requirement already satisfied: cuda-tile[tileiras] in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.5.0)
Requirement already satisfied: nvidia-ml-py in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (13.610.43)
Requirement already satisfied: packaging>=24.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (26.3)
Requirement already satisfied: tabulate in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.10.0)
Requirement already satisfied: triton in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.6.0)
Requirement already satisfied: jinja2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.1.6)
Collecting pyelftools (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached pyelftools-0.33-py3-none-any.whl.metadata (1.0 kB)
Requirement already satisfied: cuda-bindings in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.9.7)
Requirement already satisfied: nvidia-cuda-runtime-cu12 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.77)
Collecting nvidia-cuda-cccl-cu12 (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_cccl_cu12-12.9.27-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-cuda-nvcc-cu12 (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_nvcc_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.7 kB)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.85)
Requirement already satisfied: interegular>=0.3.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from lm-format-enforcer==0.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.3.3)
Requirement already satisfied: llvmlite<0.48,>=0.47.0dev0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from numba==0.65.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.47.0)
Collecting nvidia-cutlass-dsl-libs-base==4.5.2 (from nvidia-cutlass-dsl==4.5.2->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cutlass_dsl_libs_base-4.5.2-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (2.7 kB)
Requirement already satisfied: cuda-python>=12.8 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from nvidia-cutlass-dsl-libs-base==4.5.2->nvidia-cutlass-dsl==4.5.2->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.9.7)
Requirement already satisfied: torch-c-dlpack-ext in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tilelang==0.1.9->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.5)
Requirement already satisfied: ml-dtypes in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tilelang==0.1.9->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.6.0)
Requirement already satisfied: z3-solver<4.15.5,>=4.13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tilelang==0.1.9->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.15.4.0)
Requirement already satisfied: tokenspeed-triton>=3.7.10.post20260505 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tokenspeed-mla==0.1.2->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.8.10.post20260721)
Requirement already satisfied: starlette>=0.46.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi<0.137,>=0.115.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.6.0)
Requirement already satisfied: typing-inspection>=0.4.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi<0.137,>=0.115.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.4.4)
Requirement already satisfied: annotated-doc>=0.0.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi<0.137,>=0.115.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.5)
Requirement already satisfied: fastapi-cli>=0.0.8 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.32)
Requirement already satisfied: fastar>=0.9.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.11.0)
Requirement already satisfied: httpx<1.0.0,>=0.23.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.28.1)
Requirement already satisfied: python-multipart>=0.0.18 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.32)
Requirement already satisfied: email-validator>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.3.0)
Requirement already satisfied: uvicorn>=0.12.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.52.3)
Requirement already satisfied: pydantic-settings>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.15.0)
Requirement already satisfied: pydantic-extra-types>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.11.1)
Requirement already satisfied: anyio in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.14.2)
Requirement already satisfied: certifi in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.7.22)
Requirement already satisfied: httpcore==1. in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.0.9)
Requirement already satisfied: idna in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.18)
Requirement already satisfied: h11>=0.16 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpcore==1.->httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.16.0)
Requirement already satisfied: jmespath in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from model-hosting-container-standards<1.0.0,>=0.1.14->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.1.0)
Requirement already satisfied: supervisor>=4.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from model-hosting-container-standards<1.0.0,>=0.1.14->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.3.0)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.7.1)
Requirement already satisfied: aiosignal>=1.4.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.4.0)
Requirement already satisfied: attrs>=17.3.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (26.1.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.8.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (6.7.1)
Requirement already satisfied: propcache>=0.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.5.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.24.5)
Requirement already satisfied: distro<2,>=1.7.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.9.0)
Requirement already satisfied: docstring-parser<1,>=0.15 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.18.0)
Requirement already satisfied: jiter<1,>=0.4.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.16.0)
Requirement already satisfied: sniffio<2,>=1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.3.1)
Requirement already satisfied: annotated-types>=0.6.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic>=2.12.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.0)
Requirement already satisfied: pydantic-core==2.46.4 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic>=2.12.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.46.4)
Requirement already satisfied: cuda-pathfinder~=1.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-bindings->humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.2)
Requirement already satisfied: dnspython>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from email-validator>=2.0.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.8.0)
Requirement already satisfied: typer>=0.16.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.27.1)
Requirement already satisfied: rich-toolkit>=0.14.8 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.20.3)
Requirement already satisfied: fastapi-cloud-cli>=0.1.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.23.0)
Requirement already satisfied: rignore>=0.5.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cloud-cli>=0.1.1->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.1)
Requirement already satisfied: sentry-sdk>=2.20.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cloud-cli>=0.1.1->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.68.0)
Requirement already satisfied: detect-installer>=0.1.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cloud-cli>=0.1.1->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jinja2->humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.0.3)
Requirement already satisfied: jsonschema>=4.21.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.26.0)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jsonschema>=4.21.1->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2025.9.1)
Requirement already satisfied: referencing>=0.28.4 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jsonschema>=4.21.1->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.37.0)
Requirement already satisfied: rpds-py>=0.25.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jsonschema>=4.21.1->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.6.3)
Requirement already satisfied: httpx2<3,>=2.7.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from openai>=2.0.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.10.0)
Requirement already satisfied: httpcore2==2.10.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx2<3,>=2.7.0->openai>=2.0.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.10.0)
Requirement already satisfied: truststore>=0.10 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx2<3,>=2.7.0->openai>=2.0.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.10.4)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-grpc==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-http==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: googleapis-common-protos~=1.57 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.75.1)
Requirement already satisfied: grpcio<2.0.0,>=1.63.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.83.0)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-common==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-proto==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-semantic-conventions==0.65b0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-sdk>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.65b0)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from requests>=2.26.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.5.0)
Requirement already satisfied: urllib3<3,>=1.26 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from requests>=2.26.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.7.0)
Requirement already satisfied: pycountry>=23 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic-extra-types[pycountry]>=2.10.5->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (26.2.16)
Requirement already satisfied: python-dotenv>=0.21.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic-settings>=2.0.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.2)
Requirement already satisfied: rich>=13.7.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (15.0.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from rich>=13.7.1->rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from rich>=13.7.1->rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.20.0)
Requirement already satisfied: mdurl~=0.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from markdown-it-py>=2.2.0->rich>=13.7.1->rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.2)
Requirement already satisfied: huggingface-hub<2.0,>=0.16.4 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tokenizers>=0.21.1->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.27.0)
Requirement already satisfied: fsspec>=2023.5.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from huggingface-hub<2.0,>=0.16.4->tokenizers>=0.21.1->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.4.0)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from huggingface-hub<2.0,>=0.16.4->tokenizers>=0.21.1->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.6.0)
Requirement already satisfied: sympy>=1.13.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.14.0)
Requirement already satisfied: networkx>=2.5.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.6.1)
Requirement already satisfied: cuda-toolkit==12.6.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.3)
Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (9.10.2.21)
Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.7.1)
Requirement already satisfied: nvidia-nccl-cu12==2.28.9 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.28.9)
Requirement already satisfied: nvidia-nvshmem-cu12==3.4.5 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.4.5)
Requirement already satisfied: nvidia-cublas-cu12==12.6.4.1. in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (11.3.0.4)
Requirement already satisfied: nvidia-cufile-cu12==1.11.1.6.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.11.1.6)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.80)
Requirement already satisfied: nvidia-curand-cu12==10.3.7.77.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (10.3.7.77)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.1.2.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (11.7.1.2)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.4.2.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.5.4.2)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.6.85.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.85)
Requirement already satisfied: nvidia-nvtx-cu12==12.6.77.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.77)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from sympy>=1.13.3->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from typer>=0.16.0->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.5.4)
Requirement already satisfied: httptools>=0.8.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.0)
Requirement already satisfied: uvloop>=0.15.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.22.1)
Requirement already satisfied: websockets>=13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (17.0.1)
INFO: pip is looking at multiple versions of cuda-tile[tileiras] to determine which version is compatible with other requirements. This could take a while.
Collecting cuda-tile[tileiras] (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached cuda_tile-1.4.0-cp312-cp312-manylinux2014_x86_64.whl.metadata (7.4 kB)
Using cached cuda_tile-1.3.0-cp312-cp312-manylinux2014_x86_64.whl.metadata (7.3 kB)
Collecting nvidia-cuda-tileiras<13.3,>=13.2 (from cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_tileiras-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.9 kB)
Collecting nvidia-cuda-nvcc<13.3,>=13.2 (from cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_nvcc-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.9 kB)
Collecting nvidia-nvvm<13.3,>=13.2 (from cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_nvvm-13.2.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-cuda-runtime (from nvidia-cuda-nvcc<13.3,>=13.2->cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_runtime-13.3.29-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.8 kB)
Collecting nvidia-cuda-crt (from nvidia-cuda-nvcc<13.3,>=13.2->cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_crt-13.3.73-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-nvjitlink (from nvidia-cuda-tileiras<13.3,>=13.2->cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_nvjitlink-13.3.33-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.8 kB)
Requirement already satisfied: mcp-types==2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.0.0)
Requirement already satisfied: pyjwt>=2.10.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.13.0)
Requirement already satisfied: sse-starlette>=3.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.4.8)
Requirement already satisfied: cryptography>=3.4.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (50.0.0)
Requirement already satisfied: cffi>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cryptography>=3.4.0->pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.1.1)
Requirement already satisfied: pycparser in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cffi>=2.0.0->cryptography>=3.4.0->pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.0)
Using cached compressed_tensors-0.17.0-py3-none-any.whl (211 kB)
Using cached flashinfer_cubin-0.6.12-py3-none-any.whl (447.5 MB)
Using cached flashinfer_python-0.6.12-py3-none-any.whl (14.0 MB)
Using cached humming_kernels-0.1.4-py3-none-any.whl (161 kB)
Using cached nvidia_cutlass_dsl-4.5.2-py3-none-any.whl (10 kB)
Using cached nvidia_cutlass_dsl_libs_base-4.5.2-cp312-cp312-manylinux_2_28_x86_64.whl (74.5 MB)
Using cached fastapi-0.136.3-py3-none-any.whl (117 kB)
Using cached llguidance-1.7.6-cp39-abi3-manylinux_2_31_x86_64.whl (3.1 MB)
Using cached nvidia_cudnn_frontend-1.27.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (4.7 MB)
Using cached cuda_tile-1.3.0-cp312-cp312-manylinux2014_x86_64.whl (247 kB)
Using cached nvidia_cuda_nvcc-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (44.0 MB)
Using cached nvidia_cuda_tileiras-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (37.0 MB)
Using cached nvidia_nvvm-13.2.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (64.3 MB)
Using cached nvidia_cuda_cccl_cu12-12.9.27-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.2 MB)
Using cached nvidia_cuda_crt-13.3.73-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (157 kB)
Using cached nvidia_cuda_nvcc_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (40.5 MB)
Using cached nvidia_cuda_runtime-13.3.29-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (2.3 MB)
Using cached nvidia_nvjitlink-13.3.33-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (40.7 MB)
Using cached pyelftools-0.33-py3-none-any.whl (201 kB)
Building wheels for collected packages: vllm
Building editable for vllm (pyproject.toml): started
Building editable for vllm (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error

× Building editable for vllm (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [865 lines of output]
/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools_scm/_integration/version_inference.py:222: UserWarning: version of None already set
warnings.warn(f"version of {self.dist_name} already set")
running editable_wheel
creating /tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info
writing /tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info/dependency_links.txt
writing entry points to /tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info/entry_points.txt
writing requirements to /tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info/requires.txt
writing top-level names to /tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info/top_level.txt
writing manifest file '/tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file '/tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm.egg-info/SOURCES.txt'
creating '/tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm-0.23.1.dev0+g0fc695fc6.d20260815.cu126.dist-info'
creating /tmp/pip-ephem-wheel-cache-eb6ocwr7/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpx7kmzpx2/.tmp-q_1fk7js/vllm-0.23.1.dev0+g0fc695fc6.d20260815.cu126.dist-info/WHEEL
running build_py
running build_ext
Using MAX_JOBS=16 as the number of jobs.
-- The CXX compiler identification is GNU 9.4.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Build type: RelWithDebInfo
-- Target device: cuda
-- Found Python: /home/user/anaconda3/envs/verl_env/bin/python (found version "3.12.2") found components: Interpreter Development.Module Development.SABIModule
-- Found python matching: /home/user/anaconda3/envs/verl_env/bin/python.
-- Found CUDA: /usr/local/cuda (found version "12.6")
-- The CUDA compiler identification is NVIDIA 12.6.20 with host compiler GNU 9.4.0
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /usr/local/cuda/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- Found CUDAToolkit: /usr/local/cuda/include (found version "12.6.20")
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- PyTorch: CUDA detected: 12.6
-- PyTorch: CUDA nvcc is: /usr/local/cuda/bin/nvcc
-- PyTorch: CUDA toolkit directory: /usr/local/cuda
-- PyTorch: Header version is: 12.6
-- Found Python: /home/user/anaconda3/envs/verl_env/bin/python (found version "3.12.2") found components: Interpreter
-- /usr/local/cuda/lib64/libnvrtc.so shorthash is e0967580
-- USE_CUDNN is set to 0. Compiling without cuDNN support
-- USE_CUSPARSELT is set to 0. Compiling without cuSPARSELt support
-- USE_CUDSS is set to 0. Compiling without cuDSS support
-- USE_CUFILE is set to 0. Compiling without cuFile support
-- Autodetected CUDA architecture(s): 8.6 8.6 8.6 8.6 8.6 8.6 8.6
CMake Warning at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:332 (message):
pytorch is not compatible with CMAKE_CUDA_ARCHITECTURES and will ignore
its value. Please configure TORCH_CUDA_ARCH_LIST instead.
Call Stack (most recent call first):
/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)
/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:62 (find_package)
CMakeLists.txt:95 (find_package)

  -- Added CUDA NVCC flags for: -gencode;arch=compute_86,code=sm_86
  CMake Warning at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
    library kineto not found.
  Call Stack (most recent call first):
    /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:119 (append_torchlib_if_found)
    CMakeLists.txt:95 (find_package)
  
  
  -- Found Torch: /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/lib/libtorch.so
  -- CUDA target architectures: 8.6
  -- CUDA supported target architectures: 8.6
  -- FetchContent base directory: /home/user/vllm/.deps
  -- Enabling cumem allocator extension.
  -- CMake Version: 4.4.2
  -- CUTLASS 4.4.2
  -- Found CUDAToolkit: /usr/local/cuda/targets/x86_64-linux/include (found version "12.6.20")
  -- CUDART: /usr/local/cuda/lib64/libcudart.so
  -- CUDA Driver: /usr/local/cuda/lib64/stubs/libcuda.so
  -- NVRTC: /usr/local/cuda/lib64/libnvrtc.so
  -- Default Install Location: install
  -- Found Python3: /home/user/anaconda3/envs/verl_env/bin/python3.12 (found suitable version "3.12.2", minimum required is "3.5") found components: Interpreter
  -- CUDA Compilation Architectures: 70;72;75;80;86;87;89;90;90a
  -- Enable caching of reference results in conv unit tests
  -- Enable rigorous conv problem sizes in conv unit tests
  -- Grid Dependency Control (GDC) is enabled for SM100 kernels (required for programmatic dependent launches).
  -- Using the following NVCC flags:
    --expt-relaxed-constexpr
    -ftemplate-backtrace-limit=0
    -DCUTLASS_TEST_LEVEL=0
    -DCUTLASS_TEST_ENABLE_CACHED_RESULTS=1
    -DCUTLASS_CONV_UNIT_TEST_RIGOROUS_SIZE_ENABLED=1
    -DCUTLASS_DEBUG_TRACE_LEVEL=0
    -Xcompiler=-Wconversion
    -Xcompiler=-fno-strict-aliasing
    -lineinfo
  -- Configuring cublas ...
  -- cuBLAS Disabled.
  -- Configuring cuBLAS ... done.
  -- Marlin generation script hash: 305f58a60625a7c073195cdd0a653553(ARCH:8.6)
  -- Last run Marlin generate script hash:
  -- Marlin generation completed successfully.
  -- Building Marlin kernels for archs: 8.0+PTX
  -- Not building ES MXFP8 grouped kernels as no compatible archs found in CUDA target architectures.
  -- Not building Machete kernels as no compatible archs found in CUDA target architectures
  -- Enabling C extension.
  -- Not building dsv3_fused_a_gemm as no compatible archs found in CUDA target architectures.
  -- Not building fp32_router_gemm as no compatible archs found (requires SM90+ and CUDA >= 12.0).
  -- Building AllSpark kernels for archs: 8.6
  -- Not building scaled_mm_c3x_sm90 as no compatible archs found in CUDA target architectures
  -- Not building scaled_mm_c3x_120 as no compatible archs found in CUDA target architectures
  -- Not building scaled_mm_c3x_100 as no compatible archs found in CUDA target architectures
  -- Building scaled_mm_c2x for archs: 8.0
  -- Not building grouped_mm_c3x as no compatible archs found in CUDA target architectures.
  -- Not building grouped_mm_c3x as no compatible archs found in CUDA target architectures.
  -- Not building moe_data as no compatible archs found in CUDA target architectures.
  -- Not building NVFP4 as no compatible archs were found.
  -- Not building NVFP4 as no compatible archs were found.
  -- Not building W4A8 kernels as no compatible archs found in CUDA target architectures
  -- Not building CUTLASS MLA as no compatible archs were found.
  -- Building hadacore
  -- Enabling C_stable extension.
  -- Marlin MOE generation script hash with arch: e526f76458438d683d6b0afc931f1260(ARCH:8.6)
  -- Last run Marlin MOE generate script hash with arch:
  -- Marlin MOE generation completed successfully.
  -- Building Marlin MOE kernels for archs: 8.0+PTX
  -- Not building DSV3 router GEMM kernels as no compatible archs found (requires SM90+ and CUDA >= 12.0)
  -- Enabling moe extension.
  -- [triton_kernels] Fetch from https://github.com/triton-lang/triton.git:v3.5.1
  -- [triton_kernels] triton_kernels is available at /home/user/vllm/.deps/triton_kernels-src/python/triton_kernels/triton_kernels/
  CMake Warning (author) at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/cmake/data/share/cmake-4.4/Modules/FetchContent.cmake:1968 (message):
    Calling FetchContent_Populate(deepgemm) is deprecated, call
    FetchContent_MakeAvailable(deepgemm) instead.  Policy CMP0169 can be set to
    OLD to allow FetchContent_Populate(deepgemm) to be called directly for now,
    but the ability to call it with declared details will be removed completely
    in a future version.
  Call Stack (most recent call first):
    cmake/external_projects/deepgemm.cmake:35 (FetchContent_Populate)
    CMakeLists.txt:1343 (include)
  This warning is for project developers.  Use -Wno-author to suppress it.
  
  -- DeepGEMM is available at /home/user/vllm/.deps/deepgemm-src
  -- DeepGEMM will not compile: unsupported CUDA architecture 8.6
  -- FlashMLA is available at /home/user/vllm/.deps/flashmla-src
  -- FlashMLA will not compile: unsupported CUDA architecture 8.6
  CMake Warning (author) at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/cmake/data/share/cmake-4.4/Modules/FetchContent.cmake:1968 (message):
    Calling FetchContent_Populate(qutlass) is deprecated, call
    FetchContent_MakeAvailable(qutlass) instead.  Policy CMP0169 can be set to
    OLD to allow FetchContent_Populate(qutlass) to be called directly for now,
    but the ability to call it with declared details will be removed completely
    in a future version.
  Call Stack (most recent call first):
    cmake/external_projects/qutlass.cmake:27 (FetchContent_Populate)
    CMakeLists.txt:1345 (include)
  This warning is for project developers.  Use -Wno-author to suppress it.
  
  -- [QUTLASS] QuTLASS is available at /home/user/vllm/.deps/qutlass-src
  -- [QUTLASS] Skipping build: CUDA 12.8 or newer is required (found 12.6.20).
  -- Build type: RelWithDebInfo
  -- Target device: cuda
  -- Found Python: /home/user/anaconda3/envs/verl_env/bin/python (found version "3.12.2") found components: Interpreter Development.Module Development.SABIModule
  CMake Warning at .deps/vllm-flash-attn-src/CMakeLists.txt:77 (message):
    Pytorch version 2.4.0 expected for CUDA build, saw 2.11.0 instead.
  
  
  -- CUDA target architectures: 8.6
  -- CUDA supported target architectures: 8.6
  -- FA2_ARCHS: 8.0+PTX
  -- FA3_ARCHS:
  -- vllm-flash-attn is available at /home/user/vllm/.deps/vllm-flash-attn-src
  -- Configuring done (22.4s)
  -- Generating done (0.1s)
  -- Build files have been written to: /tmp/tmpvys67p01.build-temp
  Using MAX_JOBS=16 as the number of jobs.
  [1/338] Building CXX object CMakeFiles/spinloop.dir/csrc/spinloop.cpp.o
  [2/338] Building CXX object CMakeFiles/cumem_allocator.dir/csrc/cumem_allocator.cpp.o
  [3/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [4/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [5/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [6/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [7/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [8/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [9/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [10/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_86,code=sm_86 -MD -MT CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/activation_kernels.cu -o CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/CallOnce.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Context.h:27,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/cuda/CUDAContext.h:7,
                   from /home/user/vllm/csrc/quantization/activation_kernels.cu:1:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/vllm/csrc/quantization/activation_kernels.cu:2:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/activation_kernels.cu:2:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [11/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [12/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [13/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [14/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [15/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [16/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [17/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [18/338] Building CXX object CMakeFiles/_C.dir/csrc/torch_bindings.cpp.o
  ninja: build stopped: subcommand failed.
  Traceback (most recent call last):
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 139, in run
      self._create_wheel_file(bdist_wheel)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 340, in _create_wheel_file
      files, mapping = self._run_build_commands(dist_name, unpacked, lib, tmp)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 263, in _run_build_commands
      self._run_build_subcommands()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 290, in _run_build_subcommands
      self.run_command(name)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools_rust/setuptools_ext.py", line 177, in run
      super().run()
    File "<string>", line 361, in run
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
      self.build_extensions()
    File "<string>", line 330, in build_extensions
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/subprocess.py", line 413, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=16', '--target=_moe_C', '--target=cumem_allocator', '--target=triton_kernels', '--target=spinloop', '--target=_vllm_fa2_C', '--target=_vllm_fa3_C', '--target=_vllm_fa4_cutedsl_C', '--target=_deep_gemm_C', '--target=_C', '--target=_C_stable_libtorch']' returned non-zero exit status 1.
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py:1021: _DebuggingTips: Problem in editable installation.
  !!
  
          ********************************************************************************
          An error happened while installing `vllm` in editable mode.
  
          The following steps are recommended to help debug this problem:
  
          - Try to install the project normally, without using the editable mode.
            Does the error still persist?
            (If it does, try fixing the problem before attempting the editable mode).
          - If you are using binary extensions, make sure you have all OS-level
            dependencies installed (e.g. compilers, toolchains, binary libraries, ...).
          - Try the latest version of setuptools (maybe the error was already fixed).
          - If you (or your project dependencies) are using any setuptools extension
            or customization, make sure they support the editable mode.
  
          After following the steps above, if the problem still persists and
          you think this is related to how setuptools handles editable installations,
          please submit a reproducible example
          (see https://stackoverflow.com/help/minimal-reproducible-example) to:
  
              https://github.com/pypa/setuptools/issues
  
          See https://setuptools.pypa.io/en/latest/userguide/development_mode.html for details.
          ********************************************************************************
  
  !!
    cmd_obj.run()
  Traceback (most recent call last):
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
      main()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
      json_out["return_val"] = hook(**hook_input["kwargs"])
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 303, in build_editable
      return hook(wheel_directory, config_settings, metadata_directory)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 476, in build_editable
      return self._build_with_temp_dir(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
      self.run_setup()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 320, in run_setup
      exec(code, locals())
    File "<string>", line 1160, in <module>
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
      dist.run_commands()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
      self.run_command(cmd)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 139, in run
      self._create_wheel_file(bdist_wheel)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 340, in _create_wheel_file
      files, mapping = self._run_build_commands(dist_name, unpacked, lib, tmp)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 263, in _run_build_commands
      self._run_build_subcommands()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 290, in _run_build_subcommands
      self.run_command(name)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools_rust/setuptools_ext.py", line 177, in run
      super().run()
    File "<string>", line 361, in run
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
      self.build_extensions()
    File "<string>", line 330, in build_extensions
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/subprocess.py", line 413, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=16', '--target=_moe_C', '--target=cumem_allocator', '--target=triton_kernels', '--target=spinloop', '--target=_vllm_fa2_C', '--target=_vllm_fa3_C', '--target=_vllm_fa4_cutedsl_C', '--target=_deep_gemm_C', '--target=_C', '--target=_C_stable_libtorch']' returned non-zero exit status 1.
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building editable for vllm
Failed to build vllm
error: failed-wheel-build-for-install

× Failed to build installable wheels for some pyproject.toml based projects
╰─> vllm

[cqray1990]

build from source code,
cuda.txt Does it need to be modified for building from source code,?

Common dependencies

-r common.txt

numba == 0.65.0 # Required for N-gram speculative decoding

Dependencies for NVIDIA GPUs

torch==2.13.0
torchaudio==2.11.0

These must be updated alongside torch

torchvision==0.28.0 # Required for phi3v processor. See https://github.com/pytorch/vision?tab=readme-ov-file#installation for corresponding version
torchcodec >= 0.14
PyNvVideoCodec==2.0.4

FlashInfer should be updated together with the Dockerfile

flashinfer-cubin is not on PyPI since 0.6.14; setup.py excludes it from

install_requires so the published wheel does not carry an unresolvable pin

--extra-index-url https://flashinfer.ai/whl/
flashinfer-python==0.6.16.post3
flashinfer-cubin==0.6.16.post3
apache-tvm-ffi==0.1.11
tilelang==0.1.12
nvidia-cudnn-frontend>=1.19.1

Required for LLM_NVTX_SCOPES_FOR_PROFILING=1

nvtx==0.2.15

Required for faster safetensors model loading

fastsafetensors >= 0.3.3

QuACK and Cutlass DSL for FA4 (cute-DSL implementation)

nvidia-cutlass-dsl[cu13]==4.6.2
quack-kernels==0.6.4 # Required for CUTLASS DSL 4.6 by MSA

Tokenspeed_MLA for faster mla with spec decode

tokenspeed-mla==0.1.8; platform_system == "Linux"

Humming kernels for quantization gemm

humming-kernels[cu13]==0.1.12