Skip to content

Actions: open-compass/opencompass

Actions

unit_test

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
unit-test.yml
418 workflow runs
418 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
unit_test unit_test #489: Scheduled
7h 22m 15s main
main
7h 22m 15s
feat: add Atlas Cloud model config unit_test #488: Pull request #2590 opened by binyangzhu000-sudo
Action required binyangzhu000-sudo:codex/atlas-cloud-openai-config
binyangzhu000-sudo:codex/atlas-cloud-openai-config
Action required
Add multimodal C4 Bench evaluation unit_test #487: Pull request #2589 opened by sci-m-wang
Action required sci-m-wang:codex/add-c4-bench
sci-m-wang:codex/add-c4-bench
Action required
[Fix] Avoid false error logs for successful RJob submissions unit_test #486: Pull request #2588 opened by JifeiShan
Action required JifeiShan:fix/rjob-submission-logging
JifeiShan:fix/rjob-submission-logging
Action required
unit_test unit_test #485: Scheduled
1d 0h 0m 1s main
main
1d 0h 0m 1s
unit_test unit_test #484: Scheduled
1d 0h 0m 3s main
main
1d 0h 0m 3s
unit_test unit_test #483: Scheduled
23h 53m 32s main
main
23h 53m 32s
[Feat] vlmevalkit support unit_test #482: Pull request #2586 synchronize by thinszx
Action required thinszx:feat/vlmevalkit
thinszx:feat/vlmevalkit
Action required
Fix RJob failure propagation and submission logging unit_test #481: Pull request #2587 opened by JifeiShan
Action required JifeiShan:codex/propagate-rjob-failures
JifeiShan:codex/propagate-rjob-failures
Action required
unit_test unit_test #480: Scheduled
21h 42m 30s main
main
21h 42m 30s
[Feat] vlmevalkit support unit_test #479: Pull request #2586 synchronize by thinszx
Action required thinszx:feat/vlmevalkit
thinszx:feat/vlmevalkit
Action required
unit_test unit_test #478: Scheduled
2m 26s main
main
2m 26s
[Fix] ELBench: scope the safety metric correctly and fix data-loading docs unit_test #477: Pull request #2585 synchronize by YL1N
-1s YL1N:fix/elbench-safety-scope-and-docs
YL1N:fix/elbench-safety-scope-and-docs
-1s
unit_test unit_test #476: Scheduled
2m 30s main
main
2m 30s
[Fix] ELBench: scope the safety metric correctly and fix data-loading docs unit_test #475: Pull request #2585 opened by YL1N
Action required YL1N:fix/elbench-safety-scope-and-docs
YL1N:fix/elbench-safety-scope-and-docs
Action required
unit_test unit_test #474: Scheduled
2m 28s main
main
2m 28s
Add MedFailBench dataset adapter unit_test #473: Pull request #2560 synchronize by goktugozkanmd
Action required goktugozkanmd:agent/medfailbench-opencompass-v0-1
goktugozkanmd:agent/medfailbench-opencompass-v0-1
Action required
Package dataset runtime resources unit_test #472: Pull request #2584 opened by Danielxu0208
Action required Danielxu0208:agent/package-dataset-jsonl
Danielxu0208:agent/package-dataset-jsonl
Action required
Bound OpenAI REST retries and requests unit_test #471: Pull request #2583 opened by Danielxu0208
Action required Danielxu0208:agent/fix-openai-retry
Danielxu0208:agent/fix-openai-retry
Action required
Fix OpenAI SDK request forwarding unit_test #470: Pull request #2582 opened by Danielxu0208
Action required Danielxu0208:agent/fix-openai-sdk-contract
Danielxu0208:agent/fix-openai-sdk-contract
Action required
Fix option matching without cushion unit_test #469: Pull request #2576 synchronize by Danielxu0208
Action required Danielxu0208:tech/fix-option-postprocessor
Danielxu0208:tech/fix-option-postprocessor
Action required
Reject unsupported WildBench evaluation modes unit_test #468: Pull request #2577 synchronize by Danielxu0208
Action required Danielxu0208:tech/fix-wildbench-eval-mode
Danielxu0208:tech/fix-wildbench-eval-mode
Action required
Fix QuALITY hard accuracy calculation unit_test #467: Pull request #2581 opened by Danielxu0208
Action required Danielxu0208:agent/fix-quality-hard-accuracy
Danielxu0208:agent/fix-quality-hard-accuracy
Action required
Harden CRUXEval output comparison unit_test #466: Pull request #2580 opened by Danielxu0208
Action required Danielxu0208:agent/fix-cruxeval-equality
Danielxu0208:agent/fix-cruxeval-equality
Action required
Fix multi-replica metric aggregation unit_test #465: Pull request #2579 opened by Danielxu0208
Action required Danielxu0208:agent/fix-evaluator-replica-aggregation
Danielxu0208:agent/fix-evaluator-replica-aggregation
Action required