Skip to content

feat: add testing skill for QA automation - #5649

Draft
akrem-chabchoub wants to merge 3 commits into
masterfrom
testing-skill
Draft

akrem-chabchoub wants to merge 3 commits into
masterfrom
testing-skill

Conversation

@akrem-chabchoub

Copy link
Copy Markdown
Contributor

Checklist

  • I have read the coding guide.
  • My change requires a documentation update, and I have done it.
  • I have added tests to cover my changes.
  • I have added or updated fuzz targets for any code handling untrusted input.
  • I have filled out the description and linked the related issues.

Description

Open API Spec Version Changes (if applicable)

Motivation and Context (Optional)

Related Issue (Optional)

Screenshots (if appropriate):

AI Disclosure

  • This PR contains code that has been generated by an LLM.
  • I have reviewed the AI generated code thoroughly.
  • I possess the technical expertise to responsibly review the code generated in this PR.

@acud acud left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would add:

  • the test plan should be brought for approval
  • ideally inlined in the terminal, showing the test plan for every PR (in a couple of sentences)
  • operator approves the plan, and then the orchestrator runs the tests with individual subagents that report the results. a subagent per PR, not per test case (minimizes the agent's cold start time + token usage)
  • orchestrator then reports a rundown of the results + suggested fixes to any observed issues during testing and their severity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants