[Bug]: ImportError: libcudart.so.13: cannot open shared object file: No such file or directory

[cqray1990]

Your current environment

cuda 12.6
vllm 0.21.0
pytorch 2.11.0

install by pip install vllm==0.21.0

🐛 Describe the bug

(TaskRunnerV1 pid=1062823) File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/entrypoints/llm.py", line 21, in
(TaskRunnerV1 pid=1062823) from vllm.config import (
(TaskRunnerV1 pid=1062823) File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/config/init.py", line 6, in
(TaskRunnerV1 pid=1062823) from vllm.config.compilation import (
(TaskRunnerV1 pid=1062823) File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/config/compilation.py", line 22, in
(TaskRunnerV1 pid=1062823) from vllm.platforms import current_platform
(TaskRunnerV1 pid=1062823) File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/platforms/init.py", line 278, in getattr
(TaskRunnerV1 pid=1062823) _current_platform = resolve_obj_by_qualname(platform_cls_qualname)()
(TaskRunnerV1 pid=1062823) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(TaskRunnerV1 pid=1062823) File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/utils/import_utils.py", line 109, in resolve_obj_by_qualname
(TaskRunnerV1 pid=1062823) module = importlib.import_module(module_name)
(TaskRunnerV1 pid=1062823) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(TaskRunnerV1 pid=1062823) File "anaconda3/envs/verl_env/lib/python3.12/importlib/init.py", line 90, in import_module
(TaskRunnerV1 pid=1062823) return _bootstrap._gcd_import(name[level:], package, level)
(TaskRunnerV1 pid=1062823) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(TaskRunnerV1 pid=1062823) File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/platforms/cuda.py", line 21, in
(TaskRunnerV1 pid=1062823) import vllm._C # noqa
(TaskRunnerV1 pid=1062823) ^^^^^^^^^^^^^^
(TaskRunnerV1 pid=1062823) ImportError: libcudart.so.13: cannot open shared object file: No such file or directory

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[bikmeev]

This looks like a CUDA binary compatibility issue.
The PyPI installation of vllm==0.21.0 appears to have installed a wheel that expects CUDA 13 (libcudart.so.13), while the reported environment provides CUDA 12.6

Could you please share the output of the following commands?

python -m pip show vllm torch
python - <<'PY'
import torch
print("torch:", torch.__version__)
print("torch CUDA:", torch.version.cuda)
print("CUDA available:", torch.cuda.is_available())
PY
nvidia-smi
nvcc --version

Please also share whether this is a clean environment and whether vllm was installed with:

pip install vllm==0.21.0

[cqray1990]

python -m pip show vllm torch

Name: vllm
Version: 0.21.0
Summary: A high-throughput and memory-efficient inference and serving engine for LLMs
Home-page: https://github.com/vllm-project/vllm
Author: vLLM Team
Author-email:
License-Expression: Apache-2.0
Location: anaconda3/envs/verl_env/lib/python3.12/site-packages
Requires: aiohttp, anthropic, apache-tvm-ffi, blake3, cachetools, cbor2, cloudpickle, compressed-tensors, depyf, diskcache, einops, fastapi, fastsafetensors, filelock, flashinfer-cubin, flashinfer-python, gguf, ijson, lark, llguidance, lm-format-enforcer, mcp, mistral_common, model-hosting-container-standards, msgspec, ninja, numba, numpy, nvidia-cudnn-frontend, nvidia-cutlass-dsl, openai, openai-harmony, opencv-python-headless, opentelemetry-api, opentelemetry-exporter-otlp, opentelemetry-sdk, opentelemetry-semantic-conventions-ai, outlines_core, partial-json-parser, pillow, prometheus-fastapi-instrumentator, prometheus_client, protobuf, psutil, py-cpuinfo, pybase64, pydantic, python-json-logger, pyyaml, pyzmq, quack-kernels, regex, requests, sentencepiece, setproctitle, setuptools, six, tiktoken, tilelang, tokenizers, tokenspeed-mla, torch, torchaudio, torchvision, tqdm, transformers, typing_extensions, watchfiles, xgrammar
Required-by:

Name: torch
Version: 2.11.0+cu126
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org
Author:
Author-email: PyTorch Team packages@pytorch.org
License: BSD-3-Clause
Location:anaconda3/envs/verl_env/lib/python3.12/site-packages
Requires: cuda-bindings, cuda-toolkit, filelock, fsspec, jinja2, networkx, nvidia-cudnn-cu12, nvidia-cusparselt-cu12, nvidia-nccl-cu12, nvidia-nvshmem-cu12, setuptools, sympy, triton, typing-extensions
Required-by: accelerate, cache_dit, compressed-tensors, flash-attn-4, flash_attn, flashinfer-python, humming-kernels, liger_kernel, outlines, peft, quack-kernels, runai-model-streamer, st_attn, tensordict, tilelang, timm, tokenspeed-mla, torch_c_dlpack_ext, torchdata, torchvision, vllm, vsa, xgrammar

torch: 2.11.0+cu126
torch CUDA: 12.6
CUDA available: True

| NVIDIA-SMI 580.126.09 Driver Version: 580.126.09 CUDA Version: 13.0 |
+-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA RTX A6000 Off | 00000000:26:00.0 Off | Off |
| 30% 43C P2 74W / 300W | 332MiB / 49140MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 1 NVIDIA RTX A6000 Off | 00000000:27:00.0 Off | Off |
| 32% 63C P2 229W / 300W | 40568MiB / 49140MiB | 100% Default |

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Fri_Jun_14_16:34:21_PDT_2024
Cuda compilation tools, release 12.6, V12.6.20
Build cuda_12.6.r12.6/compiler.34431801_0
@bikmeev

[bikmeev]

This confirms that the failure is caused by a CUDA build mismatch.

The relevant versions are:

vLLM:          0.21.0
PyTorch:       2.11.0+cu126
torch.version.cuda: 12.6
nvcc:          12.6
NVIDIA driver: 580.126.09

Although nvidia-smi reports CUDA Version 13.0, that value represents the maximum CUDA runtime/API version supported by the installed driver. It does not mean that the current Python environment provides CUDA 13 libraries.

The installed PyTorch and local toolkit are CUDA 12.6, while the installed vLLM binary is trying to load:

libcudart.so.13

This indicates that the vLLM wheel was built against CUDA 13 and is not compatible with the CUDA 12.6 PyTorch environment.

Please try installing CUDA-matched packages in a clean environment. For example, if a CUDA 12.6 wheel is available for vLLM 0.21.0:

python -m pip uninstall -y vllm

python -m pip install \
  "vllm==0.21.0" \
  --extra-index-url https://wheels.vllm.ai/0.21.0/cu126 \
  --extra-index-url https://download.pytorch.org/whl/cu126

Alternatively, if the vLLM 0.21.0 CUDA 12.6 wheel is not available, please use a supported CUDA-matched vLLM/PyTorch combination or build vLLM from source against the existing PyTorch installation.

For a source build, the important part is:

git clone --branch v0.21.0 https://github.com/vllm-project/vllm.git
cd vllm

# Use the already installed torch==2.11.0+cu126
python -m pip install -r requirements/build/cuda.txt
python -m pip install --no-build-isolation -e .

Please verify the result with:

python - <<'PY'
import torch
import vllm

print("vLLM:", vllm.__version__)
print("PyTorch:", torch.__version__)
print("PyTorch CUDA:", torch.version.cuda)
print("CUDA available:", torch.cuda.is_available())
PY

Please do not symlink libcudart.so.12 to libcudart.so.13; those runtimes are not guaranteed to be ABI-compatible.

If the issue still reproduces after installing a CUDA-matched vLLM build, please provide:

python -m pip show vllm torch
python -m pip check
python -m pip list | grep -E 'vllm|torch|nvidia-cuda|nvidia-cudnn|triton'

At this point, the issue appears to be an installation/packaging mismatch.

[cqray1990]

This confirms that the failure is caused by a CUDA build mismatch.

The relevant versions are:

vLLM:          0.21.0
PyTorch:       2.11.0+cu126
torch.version.cuda: 12.6
nvcc:          12.6
NVIDIA driver: 580.126.09

Although nvidia-smi reports CUDA Version 13.0, that value represents the maximum CUDA runtime/API version supported by the installed driver. It does not mean that the current Python environment provides CUDA 13 libraries.

The installed PyTorch and local toolkit are CUDA 12.6, while the installed vLLM binary is trying to load:

libcudart.so.13

This indicates that the vLLM wheel was built against CUDA 13 and is not compatible with the CUDA 12.6 PyTorch environment.

Please try installing CUDA-matched packages in a clean environment. For example, if a CUDA 12.6 wheel is available for vLLM 0.21.0:

python -m pip uninstall -y vllm

python -m pip install
"vllm==0.21.0"
--extra-index-url https://wheels.vllm.ai/0.21.0/cu126
--extra-index-url https://download.pytorch.org/whl/cu126

Alternatively, if the vLLM 0.21.0 CUDA 12.6 wheel is not available, please use a supported CUDA-matched vLLM/PyTorch combination or build vLLM from source against the existing PyTorch installation.

For a source build, the important part is:

git clone --branch v0.21.0 https://github.com/vllm-project/vllm.git
cd vllm

Use the already installed torch==2.11.0+cu126

python -m pip install -r requirements/build/cuda.txt
python -m pip install --no-build-isolation -e .

Please verify the result with:

python - <<'PY'
import torch
import vllm

print("vLLM:", vllm.version)
print("PyTorch:", torch.version)
print("PyTorch CUDA:", torch.version.cuda)
print("CUDA available:", torch.cuda.is_available())
PY

Please do not symlink libcudart.so.12 to libcudart.so.13; those runtimes are not guaranteed to be ABI-compatible.

If the issue still reproduces after installing a CUDA-matched vLLM build, please provide:

python -m pip show vllm torch
python -m pip check
python -m pip list | grep -E 'vllm|torch|nvidia-cuda|nvidia-cudnn|triton'

At this point, the issue appears to be an installation/packaging mismatch.

first:

python -m pip install
"vllm==0.21.0"
--extra-index-url https://wheels.vllm.ai/0.21.0/cu126
--extra-index-url https://download.pytorch.org/whl/cu126

also raise the same error

second try complie from source code:

Use the already installed torch==2.11.0+cu126

python -m pip install -r requirements/build/cuda.txt
python -m pip install --no-build-isolation -e .

raise error also:

    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 303, in build_editable
      return hook(wheel_directory, config_settings, metadata_directory)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 474, in build_editable
      return self._build_with_temp_dir(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 410, in _build_with_temp_dir
      self.run_setup()
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
      exec(code, locals())  # noqa: S102 # exec is intentional here
      ^^^^^^^^^^^^^^^^^^^^
    File "<string>", line 1160, in <module>
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)  # type: ignore[return-value]
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 168, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 184, in run_commands
      dist.run_commands()
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1028, in run_commands
      self.run_command(cmd)
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1106, in run_command
      super().run_command(command)
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1047, in run_command
      cmd_obj.run()
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 142, in run
      self._create_wheel_file(bdist_wheel)
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 352, in _create_wheel_file
      files, mapping = self._run_build_commands(dist_name, unpacked, lib, tmp)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 275, in _run_build_commands
      self._run_build_subcommands()
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 302, in _run_build_subcommands
      self.run_command(name)
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 342, in run_command
      self.distribution.run_command(command)
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1106, in run_command
      super().run_command(command)
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1047, in run_command
      cmd_obj.run()
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools_rust/setuptools_ext.py", line 177, in run
      super().run()
    File "<string>", line 361, in run
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 95, in run
      _build_ext.run(self)
    File "anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 382, in run
      self.build_extensions()
    File "<string>", line 330, in build_extensions
    File "anaconda3/envs/verl_env/lib/python3.12/subprocess.py", line 413, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=192', '--target=_moe_C', '--target=cumem_allocator', '--target=triton_kernels', '--target=spinloop', '--target=_vllm_fa2_C', '--target=_vllm_fa3_C', '--target=_vllm_fa4_cutedsl_C', '--target=_deep_gemm_C', '--target=_C', '--target=_C_stable_libtorch']' returned non-zero exit status 2.
  An error occurred when building editable wheel for vllm.
  See debugging tips in: https://setuptools.pypa.io/en/latest/userguide/development_mode.html#debugging-tips
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building editable for vllm
Failed to build vllm
error: failed-wheel-build-for-install

× Failed to build installable wheels for some pyproject.toml based projects
╰─> vllm

[bikmeev]

On the cu126-wheel install still failing with the same libcudart.so.13 error
that is suspicious

Can you confirm with:

pip cache purge
pip uninstall -y vllm
pip install --no-cache-dir "vllm==0.21.0" --extra-index-url https://wheels.vllm.ai/0.21.0/cu126 --extra-index-url https://download.pytorch.org/whl/cu126
pip show vllm | grep Location
ldd $(python -c "import vllm, os; print(os.path.join(os.path.dirname(vllm.__file__), '_C*.so'))") | grep cudart

The ldd output will tell us definitively which libcudart the installed _C extension actually links against.

On the source build failing
the traceback you posted is just pip/setuptools wrapping the real error; the actual compiler/linker failure is further up in the log, from the cmake --build step (ninja output). Could you paste the full build log, not just the last ~30 lines? In particular, check for OOM: you're building with -j=192, which on a machine with limited RAM per core very often gets killed mid-compile (nvcc/cutlass template instantiation is memory-hungry), and that shows up as a generic exit status 2 with no clear cause in the trimmed pip output. Worth checking dmesg | grep -i "killed process" right after the failed build, and retrying with something like:

MAX_JOBS=16 python -m pip install --no-build-isolation -e . 2>&1 | tee build.log

then share build.log.

Also worth double-checking echo $CUDA_HOME and which nvcc right before the source build
if there's a second CUDA 13 toolkit installed anywhere on the system and CUDA_HOME picks that one up instead of the 12.6 one you showed earlier, the source build would again try to link against 13.

Some time i have also same filed problems during my developments, it is basicaly because of the library infrustructure or a enviromental problem. It make me confused 😕

[cqray1990]

On the cu126-wheel install still failing with the same libcudart.so.13 error that is suspicious

Can you confirm with:

pip cache purge
pip uninstall -y vllm
pip install --no-cache-dir "vllm==0.21.0" --extra-index-url https://wheels.vllm.ai/0.21.0/cu126 --extra-index-url https://download.pytorch.org/whl/cu126
pip show vllm | grep Location
ldd $(python -c "import vllm, os; print(os.path.join(os.path.dirname(vllm.__file__), '_C*.so'))") | grep cudart

The ldd output will tell us definitively which libcudart the installed _C extension actually links against.

On the source build failing the traceback you posted is just pip/setuptools wrapping the real error; the actual compiler/linker failure is further up in the log, from the cmake --build step (ninja output). Could you paste the full build log, not just the last ~30 lines? In particular, check for OOM: you're building with -j=192, which on a machine with limited RAM per core very often gets killed mid-compile (nvcc/cutlass template instantiation is memory-hungry), and that shows up as a generic exit status 2 with no clear cause in the trimmed pip output. Worth checking dmesg | grep -i "killed process" right after the failed build, and retrying with something like:

MAX_JOBS=16 python -m pip install --no-build-isolation -e . 2>&1 | tee build.log

then share build.log.

Also worth double-checking echo $CUDA_HOME and which nvcc right before the source build if there's a second CUDA 13 toolkit installed anywhere on the system and CUDA_HOME picks that one up instead of the 12.6 one you showed earlier, the source build would again try to link against 13.

Some time i have also same filed problems during my developments, it is basicaly because of the library infrustructure or a enviromental problem. It make me confused 😕

i confirm the installation
raceback (most recent call last):
File "", line 1, in
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/init.py", line 14, in
import vllm.env_override # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/env_override.py", line 87, in
import torch
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/init.py", line 442, in
from torch._C import * # noqa: F403
^^^^^^^^^^^^^^^^^^^^^^
ImportError: libcusparseLt.so.0: cannot open shared object file: No such file or directory
ldd: 缺少文件参数
试用“ldd --help”以获取更多信息。

i will rebuild an conda env,and reinstall vllm and torch from scrach

i have reinstall vllm and pytorch with a new conda by using pip install --no-cache-dir "vllm==0.21.0" --extra-index-url https://wheels.vllm.ai/0.21.0/cu126 --extra-index-url https://download.pytorch.org/whl/cu126

pip show vllm | grep Location
ldd $(python -c "import vllm, os; print(os.path.join(os.path.dirname(vllm.file), '_C*.so'))") | grep cudart

pip show vllm | grep Location
Location: /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages

ldd $(python -c "import vllm, os; print(os.path.join(os.path.dirname(vllm.file), '_C*.so'))") | grep cudart
libcudart.so.13 => not found
libcudart.so.13 => not found

it also failed,it's amazing

@bikmeev

Traceback (most recent call last):
File "verl/verl/trainer/main_ppo.py", line 184, in main
run_ppo(config, task_runner_class=TaskRunnerV1)
File "verl/verl/trainer/main_ppo.py", line 94, in run_ppo
ray.get(runner.run.remote(config))
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/ray/_private/auto_init_hook.py", line 22, in auto_init_wrapper
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/ray/_private/client_mode_hook.py", line 134, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/ray/_private/worker.py", line 2986, in get
values, debugger_breakpoint = worker.get_objects(
^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/ray/_private/worker.py", line 1050, in get_objects
raise value.as_instanceof_cause()
ray.exceptions.RayTaskError(ImportError): ray::TaskRunnerV1.run() (pid=3904868, ip=192.168.0.200, actor_id=d236e99546900310b0b3520d03000000, repr=<main_ppo.TaskRunnerV1 object at 0x7f04bd0d83b0>)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "verl/verl/trainer/main_ppo.py", line 154, in run
self.trainer.init()
File "verl/verl/trainer/ppo/v1/trainer_base.py", line 226, in init
self._setup()
File "verl/verl/trainer/ppo/v1/trainer_base.py", line 313, in _setup
self.actor_rollout_wg.init_model()
File "verl/verl/single_controller/ray/base.py", line 56, in call
output = ray.get(output)
^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^
ray.exceptions.RayTaskError(ImportError): ray::WorkerDict.actor_rollout_init_model() (pid=3907133, ip=192.168.0.200, actor_id=b62e8d274665eb4aa4c68a6c03000000, repr=<verl.single_controller.ray.base.WorkerDict object at 0x7f6b24408440>)
File "anaconda3/envs/verl_env/lib/python3.12/concurrent/futures/_base.py", line 456, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "verl/verl/single_controller/ray/base.py", line 939, in func
return getattr(self.worker_dict[key], name)(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "verl/verl/single_controller/base/decorator.py", line 431, in inner
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "verl/verl/utils/transferqueue_utils.py", line 378, in inner
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "verl/verl/workers/engine_workers.py", line 661, in init_model
rollout_cls: type[BaseRollout] = get_rollout_class(rollout_config.name, rollout_config.mode)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "verl/verl/workers/rollout/base.py", line 108, in get_rollout_class
rollout_module = importlib.import_module(module_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/importlib/init.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1387, in _gcd_import
File "", line 1360, in _find_and_load
File "", line 1331, in _find_and_load_unlocked
File "", line 935, in _load_unlocked
File "", line 995, in exec_module
File "", line 488, in _call_with_frames_removed
File "verl/verl/workers/rollout/vllm_rollout/init.py", line 17, in
from .vllm_rollout import ServerAdapter # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "verl/verl/workers/rollout/vllm_rollout/vllm_rollout.py", line 39, in
from verl.third_party.vllm import VLLM_SLEEP_LEVEL
File "verl/verl/third_party/vllm/init.py", line 49, in
from vllm import LLM
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/init.py", line 70, in getattr
module = import_module(module_name, package)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/importlib/init.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/entrypoints/llm.py", line 21, in
from vllm.config import (
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/config/init.py", line 6, in
from vllm.config.compilation import (
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/config/compilation.py", line 22, in
from vllm.platforms import current_platform
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/platforms/init.py", line 278, in getattr
_current_platform = resolve_obj_by_qualname(platform_cls_qualname)()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/utils/import_utils.py", line 109, in resolve_obj_by_qualname
module = importlib.import_module(module_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/importlib/init.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "anaconda3/envs/verl_env/lib/python3.12/site-packages/vllm/platforms/cuda.py", line 21, in
import vllm._C # noqa
^^^^^^^^^^^^^^
ImportError: libcudart.so.13: cannot open shared object file: No such file or directory

Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.
(TaskRunnerV1 pid=3904868) Unhandled error

build fron source code!!!!!

MAX_JOBS=16 python -m pip install --no-build-isolation -e . 2>&1 | tee build.log
build log

Obtaining file:///home/user/vllm
Checking if build backend supports build_editable: started
Checking if build backend supports build_editable: finished with status 'done'
Preparing editable metadata (pyproject.toml): started
Preparing editable metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: regex in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.7.19)
Requirement already satisfied: cachetools in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (7.1.7)
Requirement already satisfied: psutil in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (7.2.2)
Requirement already satisfied: sentencepiece in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.2)
Requirement already satisfied: numpy in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.3.5)
Requirement already satisfied: requests>=2.26.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.34.2)
Requirement already satisfied: tqdm in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.70.0)
Requirement already satisfied: blake3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.0.9)
Requirement already satisfied: py-cpuinfo in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (9.0.0)
Requirement already satisfied: transformers!=5.0.,!=5.1.,!=5.2.,!=5.3.,!=5.4.,!=5.5.0,>=4.56.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (5.10.4)
Requirement already satisfied: tokenizers>=0.21.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.22.2)
Requirement already satisfied: safetensors>=0.6.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.0)
Requirement already satisfied: protobuf!=6.30.,!=6.31.,!=6.32.,!=6.33.0.,!=6.33.1.,!=6.33.2.,!=6.33.3.,!=6.33.4.,>=5.29.6 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (7.35.1)
Collecting fastapi<0.137,>=0.115.0 (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached fastapi-0.136.3-py3-none-any.whl.metadata (27 kB)
Requirement already satisfied: aiohttp>=3.13.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.14.3)
Requirement already satisfied: openai>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.0.0)
Requirement already satisfied: pydantic>=2.12.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.13.4)
Requirement already satisfied: prometheus_client>=0.18.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.26.0)
Requirement already satisfied: pillow in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.2.0)
Requirement already satisfied: prometheus-fastapi-instrumentator>=7.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (8.1.0)
Requirement already satisfied: tiktoken>=0.6.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.13.0)
Requirement already satisfied: lm-format-enforcer==0.11.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.11.3)
Collecting llguidance<1.8.0,>=1.7.0 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached llguidance-1.7.6-cp39-abi3-manylinux_2_31_x86_64.whl.metadata (10 kB)
Requirement already satisfied: outlines_core==0.2.14 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.14)
Requirement already satisfied: diskcache==5.6.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (5.6.3)
Requirement already satisfied: lark==1.2.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.2)
Requirement already satisfied: xgrammar<1.0.0,>=0.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.3)
Requirement already satisfied: typing_extensions>=4.10 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.15.0)
Requirement already satisfied: filelock>=3.16.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.29.0)
Requirement already satisfied: partial-json-parser in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.2.1.1.post7)
Requirement already satisfied: pyzmq>=25.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (27.1.0)
Requirement already satisfied: msgspec in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.21.1)
Requirement already satisfied: gguf>=0.17.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.19.0)
Requirement already satisfied: mistral_common>=1.11.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.11.7)
Requirement already satisfied: opencv-python-headless>=4.13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (5.0.0.93)
Requirement already satisfied: pyyaml in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (6.0.3)
Requirement already satisfied: six>=1.16.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.17.0)
Requirement already satisfied: setuptools<81.0.0,>=77.0.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (78.1.0)
Requirement already satisfied: einops in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.2)
Collecting compressed-tensors==0.17.0 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached compressed_tensors-0.17.0-py3-none-any.whl.metadata (4.7 kB)
Requirement already satisfied: depyf==0.20.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.20.0)
Requirement already satisfied: cloudpickle in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.1.2)
Requirement already satisfied: watchfiles in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.0)
Requirement already satisfied: python-json-logger in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.1.0)
Requirement already satisfied: ninja in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.13.0)
Requirement already satisfied: pybase64 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.5.0)
Requirement already satisfied: cbor2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (6.1.4)
Requirement already satisfied: ijson in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.5.1)
Requirement already satisfied: setproctitle in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.3.7)
Requirement already satisfied: openai-harmony>=0.0.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.8)
Requirement already satisfied: anthropic>=0.71.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.122.0)
Requirement already satisfied: model-hosting-container-standards<1.0.0,>=0.1.14 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.16)
Requirement already satisfied: mcp in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.0.0)
Requirement already satisfied: opentelemetry-sdk>=1.27.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-api>=1.27.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-exporter-otlp>=1.27.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-semantic-conventions-ai>=0.4.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.5.1)
Requirement already satisfied: numba==0.65.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.65.0)
Collecting flashinfer-python==0.6.12 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached flashinfer_python-0.6.12-py3-none-any.whl.metadata (11 kB)
Collecting flashinfer-cubin==0.6.12 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached flashinfer_cubin-0.6.12-py3-none-any.whl.metadata (1.3 kB)
Requirement already satisfied: apache-tvm-ffi==0.1.9 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.9)
Requirement already satisfied: tilelang==0.1.9 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.9)
Collecting nvidia-cudnn-frontend>=1.19.1 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cudnn_frontend-1.27.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (16 kB)
Requirement already satisfied: fastsafetensors>=0.3.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.3.3)
Collecting nvidia-cutlass-dsl==4.5.2 (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cutlass_dsl-4.5.2-py3-none-any.whl.metadata (2.8 kB)
Requirement already satisfied: quack-kernels>=0.3.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.4.1)
Requirement already satisfied: tokenspeed-mla==0.1.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.2)
Collecting humming-kernels==0.1.4 (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached humming_kernels-0.1.4-py3-none-any.whl.metadata (4.1 kB)
Requirement already satisfied: torch>=2.10.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.11.0+cu126)
Requirement already satisfied: loguru in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.7.3)
Requirement already satisfied: astor in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from depyf==0.20.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.1)
Requirement already satisfied: dill in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from depyf==0.20.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.4.1)
Requirement already satisfied: click in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (8.4.2)
Requirement already satisfied: cuda-tile[tileiras] in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.5.0)
Requirement already satisfied: nvidia-ml-py in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (13.610.43)
Requirement already satisfied: packaging>=24.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (26.3)
Requirement already satisfied: tabulate in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.10.0)
Requirement already satisfied: triton in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.6.0)
Requirement already satisfied: jinja2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.1.6)
Collecting pyelftools (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached pyelftools-0.33-py3-none-any.whl.metadata (1.0 kB)
Requirement already satisfied: cuda-bindings in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.9.7)
Requirement already satisfied: nvidia-cuda-runtime-cu12 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.77)
Collecting nvidia-cuda-cccl-cu12 (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_cccl_cu12-12.9.27-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-cuda-nvcc-cu12 (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_nvcc_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.7 kB)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.85)
Requirement already satisfied: interegular>=0.3.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from lm-format-enforcer==0.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.3.3)
Requirement already satisfied: llvmlite<0.48,>=0.47.0dev0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from numba==0.65.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.47.0)
Collecting nvidia-cutlass-dsl-libs-base==4.5.2 (from nvidia-cutlass-dsl==4.5.2->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cutlass_dsl_libs_base-4.5.2-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (2.7 kB)
Requirement already satisfied: cuda-python>=12.8 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from nvidia-cutlass-dsl-libs-base==4.5.2->nvidia-cutlass-dsl==4.5.2->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.9.7)
Requirement already satisfied: torch-c-dlpack-ext in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tilelang==0.1.9->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.5)
Requirement already satisfied: ml-dtypes in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tilelang==0.1.9->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.6.0)
Requirement already satisfied: z3-solver<4.15.5,>=4.13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tilelang==0.1.9->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.15.4.0)
Requirement already satisfied: tokenspeed-triton>=3.7.10.post20260505 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tokenspeed-mla==0.1.2->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.8.10.post20260721)
Requirement already satisfied: starlette>=0.46.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi<0.137,>=0.115.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.6.0)
Requirement already satisfied: typing-inspection>=0.4.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi<0.137,>=0.115.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.4.4)
Requirement already satisfied: annotated-doc>=0.0.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi<0.137,>=0.115.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.5)
Requirement already satisfied: fastapi-cli>=0.0.8 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.32)
Requirement already satisfied: fastar>=0.9.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.11.0)
Requirement already satisfied: httpx<1.0.0,>=0.23.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.28.1)
Requirement already satisfied: python-multipart>=0.0.18 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.0.32)
Requirement already satisfied: email-validator>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.3.0)
Requirement already satisfied: uvicorn>=0.12.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.52.3)
Requirement already satisfied: pydantic-settings>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.15.0)
Requirement already satisfied: pydantic-extra-types>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.11.1)
Requirement already satisfied: anyio in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.14.2)
Requirement already satisfied: certifi in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.7.22)
Requirement already satisfied: httpcore==1. in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.0.9)
Requirement already satisfied: idna in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.18)
Requirement already satisfied: h11>=0.16 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpcore==1.->httpx<1.0.0,>=0.23.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.16.0)
Requirement already satisfied: jmespath in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from model-hosting-container-standards<1.0.0,>=0.1.14->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.1.0)
Requirement already satisfied: supervisor>=4.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from model-hosting-container-standards<1.0.0,>=0.1.14->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.3.0)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.7.1)
Requirement already satisfied: aiosignal>=1.4.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.4.0)
Requirement already satisfied: attrs>=17.3.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (26.1.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.8.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (6.7.1)
Requirement already satisfied: propcache>=0.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.5.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from aiohttp>=3.13.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.24.5)
Requirement already satisfied: distro<2,>=1.7.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.9.0)
Requirement already satisfied: docstring-parser<1,>=0.15 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.18.0)
Requirement already satisfied: jiter<1,>=0.4.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.16.0)
Requirement already satisfied: sniffio<2,>=1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from anthropic>=0.71.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.3.1)
Requirement already satisfied: annotated-types>=0.6.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic>=2.12.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.0)
Requirement already satisfied: pydantic-core==2.46.4 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic>=2.12.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.46.4)
Requirement already satisfied: cuda-pathfinder~=1.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-bindings->humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.2)
Requirement already satisfied: dnspython>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from email-validator>=2.0.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.8.0)
Requirement already satisfied: typer>=0.16.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.27.1)
Requirement already satisfied: rich-toolkit>=0.14.8 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.20.3)
Requirement already satisfied: fastapi-cloud-cli>=0.1.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.23.0)
Requirement already satisfied: rignore>=0.5.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cloud-cli>=0.1.1->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.1)
Requirement already satisfied: sentry-sdk>=2.20.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cloud-cli>=0.1.1->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.68.0)
Requirement already satisfied: detect-installer>=0.1.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from fastapi-cloud-cli>=0.1.1->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jinja2->humming-kernels==0.1.4->humming-kernels[cu12]==0.1.4->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.0.3)
Requirement already satisfied: jsonschema>=4.21.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.26.0)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jsonschema>=4.21.1->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2025.9.1)
Requirement already satisfied: referencing>=0.28.4 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jsonschema>=4.21.1->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.37.0)
Requirement already satisfied: rpds-py>=0.25.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from jsonschema>=4.21.1->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.6.3)
Requirement already satisfied: httpx2<3,>=2.7.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from openai>=2.0.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.10.0)
Requirement already satisfied: httpcore2==2.10.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx2<3,>=2.7.0->openai>=2.0.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.10.0)
Requirement already satisfied: truststore>=0.10 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from httpx2<3,>=2.7.0->openai>=2.0.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.10.4)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-grpc==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-http==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: googleapis-common-protos~=1.57 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.75.1)
Requirement already satisfied: grpcio<2.0.0,>=1.63.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.83.0)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-common==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-proto==1.44.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-exporter-otlp-proto-grpc==1.44.0->opentelemetry-exporter-otlp>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.44.0)
Requirement already satisfied: opentelemetry-semantic-conventions==0.65b0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from opentelemetry-sdk>=1.27.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.65b0)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from requests>=2.26.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.5.0)
Requirement already satisfied: urllib3<3,>=1.26 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from requests>=2.26.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.7.0)
Requirement already satisfied: pycountry>=23 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic-extra-types[pycountry]>=2.10.5->mistral_common>=1.11.3->mistral_common[image]>=1.11.3->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (26.2.16)
Requirement already satisfied: python-dotenv>=0.21.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pydantic-settings>=2.0.0->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.2.2)
Requirement already satisfied: rich>=13.7.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (15.0.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from rich>=13.7.1->rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from rich>=13.7.1->rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.20.0)
Requirement already satisfied: mdurl~=0.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from markdown-it-py>=2.2.0->rich>=13.7.1->rich-toolkit>=0.14.8->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.1.2)
Requirement already satisfied: huggingface-hub<2.0,>=0.16.4 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from tokenizers>=0.21.1->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.27.0)
Requirement already satisfied: fsspec>=2023.5.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from huggingface-hub<2.0,>=0.16.4->tokenizers>=0.21.1->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2026.4.0)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.2 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from huggingface-hub<2.0,>=0.16.4->tokenizers>=0.21.1->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.6.0)
Requirement already satisfied: sympy>=1.13.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.14.0)
Requirement already satisfied: networkx>=2.5.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.6.1)
Requirement already satisfied: cuda-toolkit==12.6.3 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.3)
Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (9.10.2.21)
Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.7.1)
Requirement already satisfied: nvidia-nccl-cu12==2.28.9 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.28.9)
Requirement already satisfied: nvidia-nvshmem-cu12==3.4.5 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.4.5)
Requirement already satisfied: nvidia-cublas-cu12==12.6.4.1. in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (11.3.0.4)
Requirement already satisfied: nvidia-cufile-cu12==1.11.1.6.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.11.1.6)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.80)
Requirement already satisfied: nvidia-curand-cu12==10.3.7.77.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (10.3.7.77)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.1.2.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (11.7.1.2)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.4.2.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.5.4.2)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.6.85.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.85)
Requirement already satisfied: nvidia-nvtx-cu12==12.6.77.* in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cuda-toolkit[cublas,cudart,cufft,cufile,cupti,curand,cusolver,cusparse,nvjitlink,nvrtc,nvtx]==12.6.3; platform_system == "Linux"->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (12.6.77)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from sympy>=1.13.3->torch>=2.10.0->compressed-tensors==0.17.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from typer>=0.16.0->fastapi-cli>=0.0.8->fastapi-cli[standard]>=0.0.8; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (1.5.4)
Requirement already satisfied: httptools>=0.8.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.8.0)
Requirement already satisfied: uvloop>=0.15.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (0.22.1)
Requirement already satisfied: websockets>=13.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from uvicorn[standard]>=0.12.0; extra == "standard"->fastapi[standard]<0.137,>=0.115.0->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (17.0.1)
INFO: pip is looking at multiple versions of cuda-tile[tileiras] to determine which version is compatible with other requirements. This could take a while.
Collecting cuda-tile[tileiras] (from flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached cuda_tile-1.4.0-cp312-cp312-manylinux2014_x86_64.whl.metadata (7.4 kB)
Using cached cuda_tile-1.3.0-cp312-cp312-manylinux2014_x86_64.whl.metadata (7.3 kB)
Collecting nvidia-cuda-tileiras<13.3,>=13.2 (from cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_tileiras-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.9 kB)
Collecting nvidia-cuda-nvcc<13.3,>=13.2 (from cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_nvcc-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.9 kB)
Collecting nvidia-nvvm<13.3,>=13.2 (from cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_nvvm-13.2.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-cuda-runtime (from nvidia-cuda-nvcc<13.3,>=13.2->cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_runtime-13.3.29-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.8 kB)
Collecting nvidia-cuda-crt (from nvidia-cuda-nvcc<13.3,>=13.2->cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_cuda_crt-13.3.73-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-nvjitlink (from nvidia-cuda-tileiras<13.3,>=13.2->cuda-tile[tileiras]->flashinfer-python==0.6.12->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126)
Using cached nvidia_nvjitlink-13.3.33-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.8 kB)
Requirement already satisfied: mcp-types==2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.0.0)
Requirement already satisfied: pyjwt>=2.10.1 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.13.0)
Requirement already satisfied: sse-starlette>=3.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.4.8)
Requirement already satisfied: cryptography>=3.4.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (50.0.0)
Requirement already satisfied: cffi>=2.0.0 in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cryptography>=3.4.0->pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (2.1.1)
Requirement already satisfied: pycparser in /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages (from cffi>=2.0.0->cryptography>=3.4.0->pyjwt[crypto]>=2.10.1->mcp->vllm==0.23.1.dev0+g0fc695fc6.d20260815.cu126) (3.0)
Using cached compressed_tensors-0.17.0-py3-none-any.whl (211 kB)
Using cached flashinfer_cubin-0.6.12-py3-none-any.whl (447.5 MB)
Using cached flashinfer_python-0.6.12-py3-none-any.whl (14.0 MB)
Using cached humming_kernels-0.1.4-py3-none-any.whl (161 kB)
Using cached nvidia_cutlass_dsl-4.5.2-py3-none-any.whl (10 kB)
Using cached nvidia_cutlass_dsl_libs_base-4.5.2-cp312-cp312-manylinux_2_28_x86_64.whl (74.5 MB)
Using cached fastapi-0.136.3-py3-none-any.whl (117 kB)
Using cached llguidance-1.7.6-cp39-abi3-manylinux_2_31_x86_64.whl (3.1 MB)
Using cached nvidia_cudnn_frontend-1.27.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (4.7 MB)
Using cached cuda_tile-1.3.0-cp312-cp312-manylinux2014_x86_64.whl (247 kB)
Using cached nvidia_cuda_nvcc-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (44.0 MB)
Using cached nvidia_cuda_tileiras-13.2.86-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (37.0 MB)
Using cached nvidia_nvvm-13.2.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (64.3 MB)
Using cached nvidia_cuda_cccl_cu12-12.9.27-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.2 MB)
Using cached nvidia_cuda_crt-13.3.73-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (157 kB)
Using cached nvidia_cuda_nvcc_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (40.5 MB)
Using cached nvidia_cuda_runtime-13.3.29-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (2.3 MB)
Using cached nvidia_nvjitlink-13.3.33-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (40.7 MB)
Using cached pyelftools-0.33-py3-none-any.whl (201 kB)
Building wheels for collected packages: vllm
Building editable for vllm (pyproject.toml): started
Building editable for vllm (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error

× Building editable for vllm (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [865 lines of output]
/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools_scm/_integration/version_inference.py:222: UserWarning: version of None already set
warnings.warn(f"version of {self.dist_name} already set")
running editable_wheel
creating /tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info
writing /tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info/dependency_links.txt
writing entry points to /tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info/entry_points.txt
writing requirements to /tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info/requires.txt
writing top-level names to /tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info/top_level.txt
writing manifest file '/tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file '/tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm.egg-info/SOURCES.txt'
creating '/tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm-0.23.1.dev0+g0fc695fc6.d20260815.cu126.dist-info'
creating /tmp/pip-ephem-wheel-cache-33hxq46c/wheels/a7/b0/6b/8c54ca05faf195124be4bd33b1c83c59cb5c54405508168468/tmpbfyc_0so/.tmp-vkeew9rz/vllm-0.23.1.dev0+g0fc695fc6.d20260815.cu126.dist-info/WHEEL
running build_py
running build_ext
Using MAX_JOBS=16 as the number of jobs.
-- The CXX compiler identification is GNU 9.4.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Build type: RelWithDebInfo
-- Target device: cuda
-- Found Python: /home/user/anaconda3/envs/verl_env/bin/python (found version "3.12.2") found components: Interpreter Development.Module Development.SABIModule
-- Found python matching: /home/user/anaconda3/envs/verl_env/bin/python.
-- Found CUDA: /usr/local/cuda (found version "12.6")
-- The CUDA compiler identification is NVIDIA 12.6.20 with host compiler GNU 9.4.0
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /usr/local/cuda/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- Found CUDAToolkit: /usr/local/cuda/include (found version "12.6.20")
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- PyTorch: CUDA detected: 12.6
-- PyTorch: CUDA nvcc is: /usr/local/cuda/bin/nvcc
-- PyTorch: CUDA toolkit directory: /usr/local/cuda
-- PyTorch: Header version is: 12.6
-- Found Python: /home/user/anaconda3/envs/verl_env/bin/python (found version "3.12.2") found components: Interpreter
-- /usr/local/cuda/lib64/libnvrtc.so shorthash is e0967580
-- USE_CUDNN is set to 0. Compiling without cuDNN support
-- USE_CUSPARSELT is set to 0. Compiling without cuSPARSELt support
-- USE_CUDSS is set to 0. Compiling without cuDSS support
-- USE_CUFILE is set to 0. Compiling without cuFile support
-- Autodetected CUDA architecture(s): 8.6 8.6 8.6 8.6 8.6 8.6 8.6
CMake Warning at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:332 (message):
pytorch is not compatible with CMAKE_CUDA_ARCHITECTURES and will ignore
its value. Please configure TORCH_CUDA_ARCH_LIST instead.
Call Stack (most recent call first):
/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)
/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:62 (find_package)
CMakeLists.txt:95 (find_package)

  -- Added CUDA NVCC flags for: -gencode;arch=compute_86,code=sm_86
  CMake Warning at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
    library kineto not found.
  Call Stack (most recent call first):
    /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:119 (append_torchlib_if_found)
    CMakeLists.txt:95 (find_package)
  
  
  -- Found Torch: /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/lib/libtorch.so
  -- CUDA target architectures: 8.6
  -- CUDA supported target architectures: 8.6
  -- FetchContent base directory: /home/user/vllm/.deps
  -- Enabling cumem allocator extension.
  -- CMake Version: 4.4.2
  -- CUTLASS 4.4.2
  -- Found CUDAToolkit: /usr/local/cuda/targets/x86_64-linux/include (found version "12.6.20")
  -- CUDART: /usr/local/cuda/lib64/libcudart.so
  -- CUDA Driver: /usr/local/cuda/lib64/stubs/libcuda.so
  -- NVRTC: /usr/local/cuda/lib64/libnvrtc.so
  -- Default Install Location: install
  -- Found Python3: /home/user/anaconda3/envs/verl_env/bin/python3.12 (found suitable version "3.12.2", minimum required is "3.5") found components: Interpreter
  -- CUDA Compilation Architectures: 70;72;75;80;86;87;89;90;90a
  -- Enable caching of reference results in conv unit tests
  -- Enable rigorous conv problem sizes in conv unit tests
  -- Grid Dependency Control (GDC) is enabled for SM100 kernels (required for programmatic dependent launches).
  -- Using the following NVCC flags:
    --expt-relaxed-constexpr
    -ftemplate-backtrace-limit=0
    -DCUTLASS_TEST_LEVEL=0
    -DCUTLASS_TEST_ENABLE_CACHED_RESULTS=1
    -DCUTLASS_CONV_UNIT_TEST_RIGOROUS_SIZE_ENABLED=1
    -DCUTLASS_DEBUG_TRACE_LEVEL=0
    -Xcompiler=-Wconversion
    -Xcompiler=-fno-strict-aliasing
    -lineinfo
  -- Configuring cublas ...
  -- cuBLAS Disabled.
  -- Configuring cuBLAS ... done.
  -- Marlin generation script hash: 305f58a60625a7c073195cdd0a653553(ARCH:8.6)
  -- Last run Marlin generate script hash:
  -- Marlin generation completed successfully.
  -- Building Marlin kernels for archs: 8.0+PTX
  -- Not building ES MXFP8 grouped kernels as no compatible archs found in CUDA target architectures.
  -- Not building Machete kernels as no compatible archs found in CUDA target architectures
  -- Enabling C extension.
  -- Not building dsv3_fused_a_gemm as no compatible archs found in CUDA target architectures.
  -- Not building fp32_router_gemm as no compatible archs found (requires SM90+ and CUDA >= 12.0).
  -- Building AllSpark kernels for archs: 8.6
  -- Not building scaled_mm_c3x_sm90 as no compatible archs found in CUDA target architectures
  -- Not building scaled_mm_c3x_120 as no compatible archs found in CUDA target architectures
  -- Not building scaled_mm_c3x_100 as no compatible archs found in CUDA target architectures
  -- Building scaled_mm_c2x for archs: 8.0
  -- Not building grouped_mm_c3x as no compatible archs found in CUDA target architectures.
  -- Not building grouped_mm_c3x as no compatible archs found in CUDA target architectures.
  -- Not building moe_data as no compatible archs found in CUDA target architectures.
  -- Not building NVFP4 as no compatible archs were found.
  -- Not building NVFP4 as no compatible archs were found.
  -- Not building W4A8 kernels as no compatible archs found in CUDA target architectures
  -- Not building CUTLASS MLA as no compatible archs were found.
  -- Building hadacore
  -- Enabling C_stable extension.
  -- Marlin MOE generation script hash with arch: e526f76458438d683d6b0afc931f1260(ARCH:8.6)
  -- Last run Marlin MOE generate script hash with arch:
  -- Marlin MOE generation completed successfully.
  -- Building Marlin MOE kernels for archs: 8.0+PTX
  -- Not building DSV3 router GEMM kernels as no compatible archs found (requires SM90+ and CUDA >= 12.0)
  -- Enabling moe extension.
  -- [triton_kernels] Fetch from https://github.com/triton-lang/triton.git:v3.5.1
  -- [triton_kernels] triton_kernels is available at /home/user/vllm/.deps/triton_kernels-src/python/triton_kernels/triton_kernels/
  CMake Warning (author) at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/cmake/data/share/cmake-4.4/Modules/FetchContent.cmake:1968 (message):
    Calling FetchContent_Populate(deepgemm) is deprecated, call
    FetchContent_MakeAvailable(deepgemm) instead.  Policy CMP0169 can be set to
    OLD to allow FetchContent_Populate(deepgemm) to be called directly for now,
    but the ability to call it with declared details will be removed completely
    in a future version.
  Call Stack (most recent call first):
    cmake/external_projects/deepgemm.cmake:35 (FetchContent_Populate)
    CMakeLists.txt:1343 (include)
  This warning is for project developers.  Use -Wno-author to suppress it.
  
  -- DeepGEMM is available at /home/user/vllm/.deps/deepgemm-src
  -- DeepGEMM will not compile: unsupported CUDA architecture 8.6
  -- FlashMLA is available at /home/user/vllm/.deps/flashmla-src
  -- FlashMLA will not compile: unsupported CUDA architecture 8.6
  CMake Warning (author) at /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/cmake/data/share/cmake-4.4/Modules/FetchContent.cmake:1968 (message):
    Calling FetchContent_Populate(qutlass) is deprecated, call
    FetchContent_MakeAvailable(qutlass) instead.  Policy CMP0169 can be set to
    OLD to allow FetchContent_Populate(qutlass) to be called directly for now,
    but the ability to call it with declared details will be removed completely
    in a future version.
  Call Stack (most recent call first):
    cmake/external_projects/qutlass.cmake:27 (FetchContent_Populate)
    CMakeLists.txt:1345 (include)
  This warning is for project developers.  Use -Wno-author to suppress it.
  
  -- [QUTLASS] QuTLASS is available at /home/user/vllm/.deps/qutlass-src
  -- [QUTLASS] Skipping build: CUDA 12.8 or newer is required (found 12.6.20).
  -- Build type: RelWithDebInfo
  -- Target device: cuda
  -- Found Python: /home/user/anaconda3/envs/verl_env/bin/python (found version "3.12.2") found components: Interpreter Development.Module Development.SABIModule
  CMake Warning at .deps/vllm-flash-attn-src/CMakeLists.txt:77 (message):
    Pytorch version 2.4.0 expected for CUDA build, saw 2.11.0 instead.
  
  
  -- CUDA target architectures: 8.6
  -- CUDA supported target architectures: 8.6
  -- FA2_ARCHS: 8.0+PTX
  -- FA3_ARCHS:
  -- vllm-flash-attn is available at /home/user/vllm/.deps/vllm-flash-attn-src
  -- Configuring done (22.9s)
  -- Generating done (0.1s)
  -- Build files have been written to: /tmp/tmpta55mlul.build-temp
  Using MAX_JOBS=16 as the number of jobs.
  [1/338] Building CXX object CMakeFiles/spinloop.dir/csrc/spinloop.cpp.o
  [2/338] Building CXX object CMakeFiles/cumem_allocator.dir/csrc/cumem_allocator.cpp.o
  [3/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [4/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe4m3fn_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [5/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [6/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [7/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_fe2m1f_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [8/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [9/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_float16_u8b128_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [10/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_u8b128_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [11/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_86,code=sm_86 -MD -MT CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/activation_kernels.cu -o CMakeFiles/_C.dir/csrc/quantization/activation_kernels.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/CallOnce.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Context.h:27,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/cuda/CUDAContext.h:7,
                   from /home/user/vllm/csrc/quantization/activation_kernels.cu:1:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/vllm/csrc/quantization/activation_kernels.cu:2:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/activation_kernels.cu:2:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [12/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [13/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe4m3fn_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [14/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_float16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [15/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_bfloat16_fe2m1f_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [16/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [17/338] Building CUDA object CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o
  FAILED: [code=1] CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o
  /usr/local/cuda/bin/nvcc -forward-unknown-to-host-compiler -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_NVSHMEM -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -I/home/user/vllm/csrc -I/home/user/vllm/.deps/cutlass-src/include -I/home/user/vllm/.deps/cutlass-src/tools/util/include -isystem /home/user/anaconda3/envs/verl_env/include/python3.12 -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include -isystem /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda/include -DONNX_NAMESPACE=onnx_c2 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -O2 -g -DNDEBUG -std=c++20 -Xcompiler=-fPIC --expt-relaxed-constexpr -DENABLE_FP8 --threads=1 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_80,code=compute_80 -MD -MT CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o -MF CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o.d -x cu -c /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu -o CMakeFiles/_C.dir/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu.o
  nvcc warning : The -std=c++20 flag is not supported with the configured host compiler. Flag will be ignored.
  In file included from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:5:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
      5 | #error C++17 or later compatible compiler is required to use PyTorch.
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBase.h:28,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:40,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:3,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:7,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/c10/util/C++17.h:25:2: error: #error You need C++17 to compile PyTorch
     25 | #error You need C++17 to compile PyTorch
        |  ^~~~~
  In file included from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/types.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:5,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/data.h:4,
                   from /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:10,
                   from /home/user/vllm/csrc/quantization/marlin/marlin.cuh:9,
                   from /home/user/vllm/csrc/quantization/marlin/kernel.h:6,
                   from /home/user/vllm/csrc/quantization/marlin/sm80_kernel_s8_u4b8_bfloat16.cu:4:
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/torch/include/ATen/ATen.h:5:2: error: #error C++17 or later compatible compiler is required to use ATen.
      5 | #error C++17 or later compatible compiler is required to use ATen.
        |  ^~~~~
  [18/338] Building CXX object CMakeFiles/_C.dir/csrc/torch_bindings.cpp.o
  ninja: build stopped: subcommand failed.
  Traceback (most recent call last):
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 139, in run
      self._create_wheel_file(bdist_wheel)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 340, in _create_wheel_file
      files, mapping = self._run_build_commands(dist_name, unpacked, lib, tmp)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 263, in _run_build_commands
      self._run_build_subcommands()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 290, in _run_build_subcommands
      self.run_command(name)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools_rust/setuptools_ext.py", line 177, in run
      super().run()
    File "<string>", line 361, in run
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
      self.build_extensions()
    File "<string>", line 330, in build_extensions
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/subprocess.py", line 413, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=16', '--target=_moe_C', '--target=cumem_allocator', '--target=triton_kernels', '--target=spinloop', '--target=_vllm_fa2_C', '--target=_vllm_fa3_C', '--target=_vllm_fa4_cutedsl_C', '--target=_deep_gemm_C', '--target=_C', '--target=_C_stable_libtorch']' returned non-zero exit status 1.
  /home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py:1021: _DebuggingTips: Problem in editable installation.
  !!
  
          ********************************************************************************
          An error happened while installing `vllm` in editable mode.
  
          The following steps are recommended to help debug this problem:
  
          - Try to install the project normally, without using the editable mode.
            Does the error still persist?
            (If it does, try fixing the problem before attempting the editable mode).
          - If you are using binary extensions, make sure you have all OS-level
            dependencies installed (e.g. compilers, toolchains, binary libraries, ...).
          - Try the latest version of setuptools (maybe the error was already fixed).
          - If you (or your project dependencies) are using any setuptools extension
            or customization, make sure they support the editable mode.
  
          After following the steps above, if the problem still persists and
          you think this is related to how setuptools handles editable installations,
          please submit a reproducible example
          (see https://stackoverflow.com/help/minimal-reproducible-example) to:
  
              https://github.com/pypa/setuptools/issues
  
          See https://setuptools.pypa.io/en/latest/userguide/development_mode.html for details.
          ********************************************************************************
  
  !!
    cmd_obj.run()
  Traceback (most recent call last):
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
      main()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
      json_out["return_val"] = hook(**hook_input["kwargs"])
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 303, in build_editable
      return hook(wheel_directory, config_settings, metadata_directory)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 476, in build_editable
      return self._build_with_temp_dir(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
      self.run_setup()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/build_meta.py", line 320, in run_setup
      exec(code, locals())
    File "<string>", line 1160, in <module>
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
      dist.run_commands()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
      self.run_command(cmd)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 139, in run
      self._create_wheel_file(bdist_wheel)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 340, in _create_wheel_file
      files, mapping = self._run_build_commands(dist_name, unpacked, lib, tmp)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 263, in _run_build_commands
      self._run_build_subcommands()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/editable_wheel.py", line 290, in _run_build_subcommands
      self.run_command(name)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools_rust/setuptools_ext.py", line 177, in run
      super().run()
    File "<string>", line 361, in run
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
      self.build_extensions()
    File "<string>", line 330, in build_extensions
    File "/home/user/anaconda3/envs/verl_env/lib/python3.12/subprocess.py", line 413, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=16', '--target=_moe_C', '--target=cumem_allocator', '--target=triton_kernels', '--target=spinloop', '--target=_vllm_fa2_C', '--target=_vllm_fa3_C', '--target=_vllm_fa4_cutedsl_C', '--target=_deep_gemm_C', '--target=_C', '--target=_C_stable_libtorch']' returned non-zero exit status 1.
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building editable for vllm
Failed to build vllm
error: failed-wheel-build-for-install

× Failed to build installable wheels for some pyproject.toml based projects
╰─> vllm