Skip to content

Commit e5c4723

Browse files
mispa-mscodex
authored andcommitted
[TokenspeedMLA] Test causal multi-token DCP contract
TokenSpeed MLA 0.1.8 already derives each query token causal key bound from the per-request bound, query length, DCP rank, and token index. Keep the grouped batch/query/head wrapper contract and cover the previously missing causal, DCP, multi-token case. Co-authored-by: OpenAI Codex <noreply@openai.com>
1 parent 8eb35c5 commit e5c4723

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

tests/v1/attention/test_mla_backends.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -844,6 +844,7 @@ def test_tokenspeed_mla_noncausal_capability():
844844
("causal", "tokens_per_decode", "dcp_world_size", "dcp_rank"),
845845
[
846846
pytest.param(True, 1, 2, 1, id="causal-dcp"),
847+
pytest.param(True, 3, 2, 1, id="causal-dcp-multi-token"),
847848
pytest.param(False, 3, 1, 0, id="noncausal-multi-token"),
848849
],
849850
)

0 commit comments

Comments
 (0)