You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs: add openjudge.me website and online playground links to READMEs
Add website badges, online trial links, and leaderboard references
across both English and Chinese READMEs to promote the online platform
(openjudge.me/app) and benchmark leaderboard (openjudge.me/leaderboard),
lowering the barrier for new users to try OpenJudge without installation.
Co-authored-by: Cursor <cursoragent@cursor.com>
@@ -30,12 +32,15 @@ OpenJudge is an **open-source evaluation framework** for **AI applications** (e.
30
32
OpenJudge provides **ready-to-use graders** and supports generating **scenario-specific rubrics (as graders)**, making this workflow **simpler**, **more professional**, and **easy to integrate** into your workflow.
31
33
It can also convert grading results into **reward signals** to help you **fine-tune** and optimize your application.
32
34
35
+
> **🚀 Try it now!** Visit [openjudge.me/app](https://openjudge.me/app/) to use graders online — no installation required. Test built-in graders, build custom rubrics, and explore evaluation results directly in your browser.
36
+
33
37
---
34
38
35
39
## 📑 Table of Contents
36
40
37
41
-[Key Features](#-key-features)
38
42
-[News](#news)
43
+
-[Online Playground](#-online-playground)
39
44
-[Installation](#-installation)
40
45
-[Quickstart](#-quickstart)
41
46
-[Integrations](#-integrations)
@@ -47,11 +52,11 @@ It can also convert grading results into **reward signals** to help you **fine-t
-**2026-01-27** - 🖥️ **OpenJudge UI** - A Streamlit-based visual interface for grader testing and Auto Arena. Run `streamlit run ui/app.py` to get started.
59
+
-**2026-01-27** - 🖥️ **OpenJudge UI** - A Streamlit-based visual interface for grader testing and Auto Arena. 👉 [Try Online](https://openjudge.me/app/) | Run locally: `streamlit run ui/app.py`
55
60
56
61
-**2026-01-05** - 🏟️ **Auto Arena** - Automatically evaluate and compare multiple models without pre-existing test data. 👉 [Documentation](https://agentscope-ai.github.io/OpenJudge/applications/auto_arena/)
57
62
@@ -124,10 +129,19 @@ summarize evaluation Rubrics from your annotated data, and generate a llm-based
124
129
125
130
Using mainstream observability platforms like **LangSmith** or **Langfuse**? We offer seamless integration to enhance their evaluators and automated evaluation capabilities. We also provide integrations with training frameworks like **VERL** for RL training. 👉 See [Integrations](#-integrations) for details
126
131
132
+
### 🌐 Online Playground
133
+
134
+
Explore OpenJudge without writing a single line of code. Our online platform at [openjudge.me/app](https://openjudge.me/app/) lets you:
135
+
-**Test graders interactively** — select a built-in grader, input your data, and see results instantly
136
+
-**Build custom rubrics** — use the zero-shot generator to create graders from task descriptions
137
+
-**View leaderboards** — compare model performance across evaluation benchmarks at [openjudge.me/leaderboard](https://openjudge.me/leaderboard)
138
+
127
139
---
128
140
129
141
## 📥 Installation
130
142
143
+
> 💡 **Don't want to install anything?**[Try OpenJudge online](https://openjudge.me/app/) — use graders directly in your browser, no setup needed.
144
+
131
145
```bash
132
146
pip install py-openjudge
133
147
```
@@ -387,6 +401,6 @@ If you use OpenJudge in your research, please cite:
0 commit comments