Labsco
openai logo

test-triage

✓ Official★ 4,081

by openai · part of openai/plugins

Triage macOS tests across Xcode and SwiftPM. Use when narrowing failures, explaining assertions or crashes, or separating setup from regressions.

🔥🔥🔥✓ VerifiedFreeQuick setup
#automation#git
🧩 One of 7 skills in the openai/plugins package — works on its own, and pairs well with its siblings.

This is the playbook your agent receives when the skill activates — you don't need to read it to use the skill, but it's here to audit before installing.

Test Triage

Workflow

  1. Detect the test harness.

    • Use xcodebuild test for Xcode-based projects.
    • Use swift test for SwiftPM packages.

  2. Narrow the scope.

    • If the user gave a target, product, or test filter, use it.
    • If not, prefer the smallest likely failing target before a full suite.

  3. Classify the result.

    • Build failure
    • Assertion failure
    • Crash or signal
    • Async timing or flake
    • Environment or fixture setup issue
    • Missing entitlement or host app issue

  4. Rerun intelligently.

    • Use focused reruns when a specific case fails.
    • Avoid burning time on full-suite reruns without new information.

  5. Summarize clearly.

    • What command ran
    • Which tests failed
    • What kind of failure it was
    • The best next proof step or fix path

Guardrails

  • Distinguish compilation failures from test execution failures.
  • Call out when a test appears to assume iOS-only or simulator-only behavior.
  • Mark likely flakes as such instead of overstating confidence.

Output Expectations

Provide:

  • the command used
  • the smallest failing scope
  • the top failure category
  • a concise explanation of the likely cause
  • the next rerun or fix step