Skip to content

Actions: open-compass/opencompass

Actions

pr_stage_test

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
pr-stage-check.yml
485 workflow runs
485 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
feat: add Atlas Cloud model config pr_stage_test #2485: Pull request #2590 opened by binyangzhu000-sudo
Action required binyangzhu000-sudo:codex/atlas-cloud-openai-config
binyangzhu000-sudo:codex/atlas-cloud-openai-config
Action required
Add multimodal C4 Bench evaluation pr_stage_test #2484: Pull request #2589 opened by sci-m-wang
Action required sci-m-wang:codex/add-c4-bench
sci-m-wang:codex/add-c4-bench
Action required
[Fix] Avoid false error logs for successful RJob submissions pr_stage_test #2483: Pull request #2588 opened by JifeiShan
Action required JifeiShan:fix/rjob-submission-logging
JifeiShan:fix/rjob-submission-logging
Action required
[Feat] vlmevalkit support pr_stage_test #2482: Pull request #2586 synchronize by thinszx
Action required thinszx:feat/vlmevalkit
thinszx:feat/vlmevalkit
Action required
Fix RJob failure propagation and submission logging pr_stage_test #2481: Pull request #2587 opened by JifeiShan
Action required JifeiShan:codex/propagate-rjob-failures
JifeiShan:codex/propagate-rjob-failures
Action required
[Feat] vlmevalkit support pr_stage_test #2480: Pull request #2586 synchronize by thinszx
Action required thinszx:feat/vlmevalkit
thinszx:feat/vlmevalkit
Action required
[Fix] ELBench: scope the safety metric correctly and fix data-loading docs pr_stage_test #2479: Pull request #2585 synchronize by YL1N
Action required YL1N:fix/elbench-safety-scope-and-docs
YL1N:fix/elbench-safety-scope-and-docs
Action required
[Fix] ELBench: scope the safety metric correctly and fix data-loading docs pr_stage_test #2478: Pull request #2585 opened by YL1N
Action required YL1N:fix/elbench-safety-scope-and-docs
YL1N:fix/elbench-safety-scope-and-docs
Action required
Add MedFailBench dataset adapter pr_stage_test #2477: Pull request #2560 synchronize by goktugozkanmd
Action required goktugozkanmd:agent/medfailbench-opencompass-v0-1
goktugozkanmd:agent/medfailbench-opencompass-v0-1
Action required
Package dataset runtime resources pr_stage_test #2476: Pull request #2584 opened by Danielxu0208
Action required Danielxu0208:agent/package-dataset-jsonl
Danielxu0208:agent/package-dataset-jsonl
Action required
Bound OpenAI REST retries and requests pr_stage_test #2475: Pull request #2583 opened by Danielxu0208
Action required Danielxu0208:agent/fix-openai-retry
Danielxu0208:agent/fix-openai-retry
Action required
Fix OpenAI SDK request forwarding pr_stage_test #2474: Pull request #2582 opened by Danielxu0208
Action required Danielxu0208:agent/fix-openai-sdk-contract
Danielxu0208:agent/fix-openai-sdk-contract
Action required
Fix option matching without cushion pr_stage_test #2473: Pull request #2576 synchronize by Danielxu0208
Action required Danielxu0208:tech/fix-option-postprocessor
Danielxu0208:tech/fix-option-postprocessor
Action required
Reject unsupported WildBench evaluation modes pr_stage_test #2472: Pull request #2577 synchronize by Danielxu0208
Action required Danielxu0208:tech/fix-wildbench-eval-mode
Danielxu0208:tech/fix-wildbench-eval-mode
Action required
Fix QuALITY hard accuracy calculation pr_stage_test #2471: Pull request #2581 opened by Danielxu0208
Action required Danielxu0208:agent/fix-quality-hard-accuracy
Danielxu0208:agent/fix-quality-hard-accuracy
Action required
Harden CRUXEval output comparison pr_stage_test #2470: Pull request #2580 opened by Danielxu0208
Action required Danielxu0208:agent/fix-cruxeval-equality
Danielxu0208:agent/fix-cruxeval-equality
Action required
Fix multi-replica metric aggregation pr_stage_test #2469: Pull request #2579 opened by Danielxu0208
Action required Danielxu0208:agent/fix-evaluator-replica-aggregation
Danielxu0208:agent/fix-evaluator-replica-aggregation
Action required
Fix BABILong 2k config syntax pr_stage_test #2468: Pull request #2578 opened by Danielxu0208
-1s Danielxu0208:tech/fix-babilong-config
Danielxu0208:tech/fix-babilong-config
-1s
Reject unsupported WildBench evaluation modes pr_stage_test #2467: Pull request #2577 opened by Danielxu0208
Action required Danielxu0208:tech/fix-wildbench-eval-mode
Danielxu0208:tech/fix-wildbench-eval-mode
Action required
Fix option matching without cushion pr_stage_test #2466: Pull request #2576 opened by Danielxu0208
Action required Danielxu0208:tech/fix-option-postprocessor
Danielxu0208:tech/fix-option-postprocessor
Action required
[Datasets] add cruxeval and update some base eval configs pr_stage_test #2464: Pull request #2572 synchronize by Myhs-phz
5m 20s Myhs-phz:baseapi0728
Myhs-phz:baseapi0728
5m 20s
[Datasets] add cruxeval and update some base eval configs pr_stage_test #2463: Pull request #2572 synchronize by Myhs-phz
5m 33s Myhs-phz:baseapi0728
Myhs-phz:baseapi0728
5m 33s
[Datasets] add cruxeval and update some base eval configs pr_stage_test #2462: Pull request #2572 synchronize by Myhs-phz
6m 56s Myhs-phz:baseapi0728
Myhs-phz:baseapi0728
6m 56s
[Datasets] add cruxeval and update some base eval configs pr_stage_test #2461: Pull request #2572 synchronize by Myhs-phz
5m 13s Myhs-phz:baseapi0728
Myhs-phz:baseapi0728
5m 13s
[Datasets] add cruxeval and update some base eval configs pr_stage_test #2460: Pull request #2572 synchronize by Myhs-phz
5m 32s Myhs-phz:baseapi0728
Myhs-phz:baseapi0728
5m 32s