Skip to content

fix(dev): prevent empty documentation quality report issues#38099

Closed
Copilot wants to merge 3 commits into
mainfrom
copilot/daily-report-documentation-quality-2026-06-09
Closed

fix(dev): prevent empty documentation quality report issues#38099
Copilot wants to merge 3 commits into
mainfrom
copilot/daily-report-documentation-quality-2026-06-09

Conversation

Copilot AI commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

The dev workflow was creating issues with an empty body (bodyLength=1). The agent called create_issue without populating the report content, producing useless daily reports.

Three root causes:

  • strict: false — no enforcement on safe-output tool call structure, letting the agent emit an empty body
  • Missing toolsets — no toolsets: [default] under tools.github, likely limiting search_issues availability
  • No body template — the prompt said "compile a report" but never specified what the body must contain

Changes

  • dev.md: strict: falsestrict: true
  • dev.md: added toolsets: [default] under tools.github
  • dev.md: replaced vague 4-point requirements list with explicit 3-step process and a required Markdown body template (Summary → Issues Found table → Documentation Gaps → Could-Be-Closed → Recommendations); agent must either fill all sections or call noop
  • dev.lock.yml: recompiled
  • compiler_validators.go: moved validateSafeOutputsStepsShellExpansion into the always-error validation table, removing the strict-mode conditional — dangerous shell expansion patterns in safe-outputs.steps scripts are now always a compilation error regardless of the strict frontmatter flag
# before
strict: false
tools:
  github:
    mode: gh-proxy

# after
strict: true
tools:
  github:
    mode: gh-proxy
    toolsets:
      - default

…event empty reports

- Set strict: true to enforce structured safe-output tool calls
- Add toolsets: [default] under tools.github for issue search capability
- Rewrite prompt with numbered steps and required issue body template
- Make explicit: call create_issue with full body, or noop if nothing found
- Recompile dev.lock.yml to pick up the changes

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Update documentation quality report for 2026-06-09 fix(dev): prevent empty documentation quality report issues Jun 9, 2026
Copilot AI requested a review from pelikhan June 9, 2026 12:05
@pelikhan

pelikhan commented Jun 9, 2026

Copy link
Copy Markdown
Collaborator

@copilot always enforce safeoutputs structure, regardless of strict state.

… of strict mode

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI commented Jun 9, 2026

Copy link
Copy Markdown
Contributor Author

@copilot always enforce safeoutputs structure, regardless of strict state.

Done in 6e74b8b. Moved validateSafeOutputsStepsShellExpansion into the always-error validation table in compiler_validators.go, removing the strict-mode conditional. Shell expansion violations in safe-outputs.steps scripts are now always a compilation error regardless of the strict frontmatter flag.

@pelikhan pelikhan closed this Jun 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Daily Report] Documentation Quality Report — 2026-06-09

2 participants