Skip to content

Pull requests: open-compass/opencompass

New pull request New
63 Open 1,187 Closed
63 Open 1,187 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Fix] Rename smolinstruct_pp_acc_0_shot_instruct dataset list as {}_datasets
#2340 opened Dec 2, 2025 by cnlnpjhsy Loading…
@liushz
[Doc]Update evaluation configuration for Qwen3 model
#2332 opened Nov 26, 2025 by LukeLIN-web Loading…
6 tasks
[Dataset] Add ARC_AGI_2 Public Eval Set
#2330 opened Nov 26, 2025 by Myhs-phz Loading…
feat(config): add Meta-Llama-3.1-8B-Instruct for MMLU benchmark
#2325 opened Nov 25, 2025 by 6taco Loading…
6 tasks
@liushz
1
add scireasoner datasets
#2323 opened Nov 25, 2025 by yusun-nlp Loading…
@liushz
Refactor backend switch logic with support for SGLang and OpenAI backends
#2286 opened Oct 8, 2025 by Copilot AI • Draft
@tonysy
Add ProcessBench dataset and evaluation configuration
#2274 opened Sep 16, 2025 by sudanl Loading…
6 tasks done
@liushz
1
[fix] Handle None value for max_out_len parameter in HuggingFace model
#2271 opened Sep 15, 2025 by Nexround Loading…
@bittersweet1999
Reasonzoo
#2256 opened Sep 1, 2025 by epsilondylan Loading…
2 tasks
@bittersweet1999
[Feature] Support pass@1 evaluation for multi predictions in MathEvaluator
#2253 opened Aug 28, 2025 by DELEnomore Loading…
@acylam
3
[Update] compassbench subjective config
#2238 opened Aug 14, 2025 by Myhs-phz Loading…
@acylam
feat: Add Zebra Grid dataset support with ZeroEval alignment
#2234 opened Aug 11, 2025 by max-yue Loading…
@bittersweet1999
[fix] switch think mode
#2233 opened Aug 10, 2025 by Tianhao-Peng Loading…
2 of 6 tasks
@tonysy
[Fix] add tqdm for BlueLMAPI
#2226 opened Aug 1, 2025 by Myhs-phz Loading…
@tonysy
[Feature] Support eval for C-Eval test split
#2218 opened Jul 24, 2025 by HYZ17 Loading…
@acylam
1
[Fix] Modify error handling and fix typo
#2216 opened Jul 24, 2025 by Owen-Qin Loading…
@acylam
[Fix] Deprecate unused and error formated math500 gen file
#2206 opened Jul 17, 2025 by liushz Loading…
6 tasks
@acylam
[Fix] livecodebench serialization and timeout errors
#2204 opened Jul 15, 2025 by f14-bertolotti Loading…
6 tasks
@liushz
fix bug in openai_api
#2200 opened Jul 11, 2025 by LKJacky Loading…
@tonysy
ruler os.environ fix
#2191 opened Jul 9, 2025 by f14-bertolotti Loading…
@MaiziXiao
feat:enhanced mbpp process answer patterns
#2187 opened Jul 8, 2025 by ShikangPang Loading…
6 tasks
@liushz
[fix] Update README.md with a typo
#2177 opened Jul 1, 2025 by ktwu01 Loading…
@liushz
Add GrandPhysics dataset
#2118 opened May 26, 2025 by Xiao-Youth Loading…
1 of 6 tasks
@bittersweet1999
3
PromptCBLUE:Life Science dataset
#2073 opened May 4, 2025 by tchenglv520 Loading…
6 tasks done
@tonysy
Fix mkdir hardcode in runners and partitioners
#2060 opened Apr 28, 2025 by BIGWangYuDong Loading…
@bittersweet1999
3
ProTip! Adding no:label will show everything without a label.