Your current environment
vllm/vllm-openai-rocm:minimax-m3
🐛 Describe the bug
hi @andyluo7
+viz @chunfangamd @powderluv @hongxiayang
can u take a look? is there any validated DI recipe (whether MoRI or RIXL or Mooncake, the KVCache transfer engine doesn't matter to us for week 0 enablement) for ROCm M3 yet?
evals fail on TP8 Prefill + TP8 Decode SemiAnalysisAI/InferenceX#1762
https://github.com/SemiAnalysisAI/InferenceX/actions/runs/27526046669/job/81353671922?pr=1762
Before submitting a new issue...
Your current environment
vllm/vllm-openai-rocm:minimax-m3🐛 Describe the bug
hi @andyluo7
+viz @chunfangamd @powderluv @hongxiayang
can u take a look? is there any validated DI recipe (whether MoRI or RIXL or Mooncake, the KVCache transfer engine doesn't matter to us for week 0 enablement) for ROCm M3 yet?
evals fail on TP8 Prefill + TP8 Decode SemiAnalysisAI/InferenceX#1762
https://github.com/SemiAnalysisAI/InferenceX/actions/runs/27526046669/job/81353671922?pr=1762
Before submitting a new issue...