Skip to content

Commit 33a28fb

Browse files
XiaoBoAIcursoragent
andcommitted
docs: add openjudge.me website and online playground links to READMEs
Add website badges, online trial links, and leaderboard references across both English and Chinese READMEs to promote the online platform (openjudge.me/app) and benchmark leaderboard (openjudge.me/leaderboard), lowering the barrier for new users to try OpenJudge without installation. Co-authored-by: Cursor <cursoragent@cursor.com>
1 parent b0b96d0 commit 33a28fb

2 files changed

Lines changed: 37 additions & 7 deletions

File tree

README.md

Lines changed: 18 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -15,8 +15,10 @@
1515
[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue?logo=python)](https://pypi.org/project/py-openjudge/)
1616
[![PyPI](https://img.shields.io/badge/pypi-v0.2.0-blue?logo=pypi)](https://pypi.org/project/py-openjudge/)
1717
[![Documentation](https://img.shields.io/badge/docs-online-blue?logo=readthedocs&logoColor=white)](https://agentscope-ai.github.io/OpenJudge/)
18+
[![Website](https://img.shields.io/badge/website-openjudge.me-blue?logo=googlechrome&logoColor=white)](https://openjudge.me/)
19+
[![Try Online](https://img.shields.io/badge/try%20online-free-brightgreen?logo=rocket&logoColor=white)](https://openjudge.me/app/)
1820

19-
[📖 Documentation](https://agentscope-ai.github.io/OpenJudge/) | [🤝 Contributing](https://agentscope-ai.github.io/OpenJudge/community/contributing/) | [中文](./README_zh.md)
21+
[🌐 Website](https://openjudge.me/) | [🚀 Try Online](https://openjudge.me/app/) | [📖 Documentation](https://agentscope-ai.github.io/OpenJudge/) | [🤝 Contributing](https://agentscope-ai.github.io/OpenJudge/community/contributing/) | [中文](./README_zh.md)
2022

2123
</div>
2224

@@ -30,12 +32,15 @@ OpenJudge is an **open-source evaluation framework** for **AI applications** (e.
3032
OpenJudge provides **ready-to-use graders** and supports generating **scenario-specific rubrics (as graders)**, making this workflow **simpler**, **more professional**, and **easy to integrate** into your workflow.
3133
It can also convert grading results into **reward signals** to help you **fine-tune** and optimize your application.
3234

35+
> **🚀 Try it now!** Visit [openjudge.me/app](https://openjudge.me/app/) to use graders online — no installation required. Test built-in graders, build custom rubrics, and explore evaluation results directly in your browser.
36+
3337
---
3438

3539
## 📑 Table of Contents
3640

3741
- [Key Features](#-key-features)
3842
- [News](#news)
43+
- [Online Playground](#-online-playground)
3944
- [Installation](#-installation)
4045
- [Quickstart](#-quickstart)
4146
- [Integrations](#-integrations)
@@ -47,11 +52,11 @@ It can also convert grading results into **reward signals** to help you **fine-t
4752

4853
## News
4954

50-
- **2026-02-12** - 📚 **Reference Hallucination Arena** - Benchmark for evaluating LLM academic reference hallucination. 👉 [Documentation](./docs/validating_graders/ref_hallucination_arena.md)
55+
- **2026-02-12** - 📚 **Reference Hallucination Arena** - Benchmark for evaluating LLM academic reference hallucination. 👉 [Documentation](./docs/validating_graders/ref_hallucination_arena.md) | 📊 [Leaderboard](https://openjudge.me/leaderboard)
5156

5257
- **2026-01-27** - 🆕 **Paper Review** - Automatically review academic papers using LLM-powered evaluation. 👉 [Documentation](https://agentscope-ai.github.io/OpenJudge/applications/paper_review/)
5358

54-
- **2026-01-27** - 🖥️ **OpenJudge UI** - A Streamlit-based visual interface for grader testing and Auto Arena. Run `streamlit run ui/app.py` to get started.
59+
- **2026-01-27** - 🖥️ **OpenJudge UI** - A Streamlit-based visual interface for grader testing and Auto Arena. 👉 [Try Online](https://openjudge.me/app/) | Run locally: `streamlit run ui/app.py`
5560

5661
- **2026-01-05** - 🏟️ **Auto Arena** - Automatically evaluate and compare multiple models without pre-existing test data. 👉 [Documentation](https://agentscope-ai.github.io/OpenJudge/applications/auto_arena/)
5762

@@ -124,10 +129,19 @@ summarize evaluation Rubrics from your annotated data, and generate a llm-based
124129

125130
Using mainstream observability platforms like **LangSmith** or **Langfuse**? We offer seamless integration to enhance their evaluators and automated evaluation capabilities. We also provide integrations with training frameworks like **VERL** for RL training. 👉 See [Integrations](#-integrations) for details
126131

132+
### 🌐 Online Playground
133+
134+
Explore OpenJudge without writing a single line of code. Our online platform at [openjudge.me/app](https://openjudge.me/app/) lets you:
135+
- **Test graders interactively** — select a built-in grader, input your data, and see results instantly
136+
- **Build custom rubrics** — use the zero-shot generator to create graders from task descriptions
137+
- **View leaderboards** — compare model performance across evaluation benchmarks at [openjudge.me/leaderboard](https://openjudge.me/leaderboard)
138+
127139
---
128140

129141
## 📥 Installation
130142

143+
> 💡 **Don't want to install anything?** [Try OpenJudge online](https://openjudge.me/app/) — use graders directly in your browser, no setup needed.
144+
131145
```bash
132146
pip install py-openjudge
133147
```
@@ -387,6 +401,6 @@ If you use OpenJudge in your research, please cite:
387401

388402
**Made with ❤️ by the OpenJudge Team**
389403

390-
[⭐ Star Us](https://github.com/agentscope-ai/OpenJudge) · [🐛 Report Bug](https://github.com/agentscope-ai/OpenJudge/issues) · [💡 Request Feature](https://github.com/agentscope-ai/OpenJudge/issues)
404+
[🌐 Website](https://openjudge.me/) · [🚀 Try Online](https://openjudge.me/app/) · [⭐ Star Us](https://github.com/agentscope-ai/OpenJudge) · [🐛 Report Bug](https://github.com/agentscope-ai/OpenJudge/issues) · [💡 Request Feature](https://github.com/agentscope-ai/OpenJudge/issues)
391405

392406
</div>

README_zh.md

Lines changed: 19 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,8 +15,10 @@
1515
[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue?logo=python)](https://pypi.org/project/py-openjudge/)
1616
[![PyPI](https://img.shields.io/badge/pypi-v0.2.0-blue?logo=pypi)](https://pypi.org/project/py-openjudge/)
1717
[![Documentation](https://img.shields.io/badge/docs-online-blue?logo=readthedocs&logoColor=white)](https://agentscope-ai.github.io/OpenJudge/)
18+
[![官方网站](https://img.shields.io/badge/官网-openjudge.me-blue?logo=googlechrome&logoColor=white)](https://openjudge.me/)
19+
[![在线试用](https://img.shields.io/badge/在线试用-免费体验-brightgreen?logo=rocket&logoColor=white)](https://openjudge.me/app/)
1820

19-
[📖 文档](https://agentscope-ai.github.io/OpenJudge/) | [🤝 贡献指南](https://agentscope-ai.github.io/OpenJudge/community/contributing/) | [English](./README.md)
21+
[🌐 官方网站](https://openjudge.me/) | [🚀 在线试用](https://openjudge.me/app/) | [📖 文档](https://agentscope-ai.github.io/OpenJudge/) | [🤝 贡献指南](https://agentscope-ai.github.io/OpenJudge/community/contributing/) | [English](./README.md)
2022

2123
</div>
2224

@@ -29,12 +31,15 @@ OpenJudge 是一个 **开源评估框架**,用于 **AI 应用**(如智能体
2931
3032
OpenJudge 提供**即用型评分器**,并支持生成**场景特定的评估标准(作为评分器)**,让这一流程更**简单**、更**专业**、更易于集成。它还可将评分结果转换为**奖励信号**,帮助你**微调**并优化应用。
3133

34+
> **🚀 立即在线体验!** 访问 [openjudge.me/app](https://openjudge.me/app/) 在线使用评估器 — 无需安装。你可以直接在浏览器中测试内置评分器、构建自定义评估标准、查看评估结果。
35+
3236
---
3337

3438
## 📑 目录
3539

3640
- [核心特性](#-核心特性)
3741
- [最新动态](#最新动态)
42+
- [在线体验平台](#-在线体验平台)
3843
- [安装](#-安装)
3944
- [快速开始](#-快速开始)
4045
- [集成](#-集成)
@@ -109,10 +114,19 @@ OpenJudge 提供**即用型评分器**,并支持生成**场景特定的评估
109114

110115
如果您正在使用主流可观测性平台(如 **LangSmith****Langfuse**),我们提供无缝集成方案,可增强平台的评测器和自动评测能力。我们也提供与训练框架(如 **VERL**)的集成方案,用于强化学习训练。👉 查看 [集成](#-集成) 了解详情
111116

117+
### 🌐 在线体验平台
118+
119+
无需编写代码即可体验 OpenJudge。我们的在线平台 [openjudge.me/app](https://openjudge.me/app/) 支持:
120+
- **交互式测试评分器** — 选择内置评分器,输入数据,即时查看评估结果
121+
- **构建自定义评估标准** — 使用零样本生成器,通过任务描述生成评分器
122+
- **查看排行榜** — 对比不同模型在各评估基准上的表现:[openjudge.me/leaderboard](https://openjudge.me/leaderboard)
123+
112124
----
113125
## 最新动态
114126

115-
- **2026-02-12** - 📚 **Reference Hallucination Arena** - 评估大语言模型学术引用幻觉的基准测试。 👉 [文档](./docs/validating_graders/ref_hallucination_arena.md)
127+
- **2026-02-12** - 📚 **Reference Hallucination Arena** - 评估大语言模型学术引用幻觉的基准测试。 👉 [文档](./docs/validating_graders/ref_hallucination_arena.md) | 📊 [排行榜](https://openjudge.me/leaderboard)
128+
129+
- **2026-01-27** - 🖥️ **OpenJudge UI** - 基于 Streamlit 的可视化界面,支持评分器测试和 Auto Arena。👉 [在线体验](https://openjudge.me/app/) | 本地运行:`streamlit run ui/app.py`
116130

117131
- **2025-12-26** - 在 [PyPI](https://pypi.org/project/py-openjudge/) 上发布 OpenJudge v0.2.0 - **重大更新!** 此版本通过在奖励构建之上添加对多样化评估场景的强大支持,扩展了我们的核心能力。通过统一奖励和评估信号,OpenJudge v0.2.0 提供了一种更全面的方法来优化应用性能和卓越性。→ [迁移指南](#迁移指南v01x--v020)
118132

@@ -124,6 +138,8 @@ OpenJudge 提供**即用型评分器**,并支持生成**场景特定的评估
124138

125139
## 📥 安装
126140

141+
> 💡 **不想安装?** [在线体验 OpenJudge](https://openjudge.me/app/) — 直接在浏览器中使用评分器,无需任何配置。
142+
127143
```bash
128144
pip install py-openjudge
129145
```
@@ -382,7 +398,7 @@ pip install rm-gallery
382398

383399
**由 OpenJudge 团队用 ❤️ 打造**
384400

385-
[⭐ 给我们 Star](https://github.com/agentscope-ai/OpenJudge) · [🐛 报告 Bug](https://github.com/agentscope-ai/OpenJudge/issues) · [💡 提议功能](https://github.com/agentscope-ai/OpenJudge/issues)
401+
[🌐 官方网站](https://openjudge.me/) · [🚀 在线试用](https://openjudge.me/app/) · [⭐ 给我们 Star](https://github.com/agentscope-ai/OpenJudge) · [🐛 报告 Bug](https://github.com/agentscope-ai/OpenJudge/issues) · [💡 提议功能](https://github.com/agentscope-ai/OpenJudge/issues)
386402

387403
</div>
388404

0 commit comments

Comments
 (0)