Automate Workflow
Expands test automation coverage by generating comprehensive test suites at appropriate levels (E2E, API, Component, Unit) with supporting infrastructure. This workflow operates in dual mode - works seamlessly WITH or WITHOUT BMad artifacts.
Core Principle: Generate prioritized, deterministic tests that avoid duplicate coverage and follow testing best practices.
Usage
bmad tea *automate
The TEA agent runs this workflow when:
- BMad-Integrated: After story implementation to expand coverage beyond ATDD tests
- Standalone: Point at any codebase/feature and generate tests independently ("work out of thin air")
- Auto-discover: No targets specified - scans codebase for features needing tests
Inputs
Execution Modes:
- BMad-Integrated Mode (story available) - OPTIONAL
- Standalone Mode (no BMad artifacts) - Direct code analysis
- Auto-discover Mode (no targets) - Scan for coverage gaps
Required Context Files:
- Framework configuration: Test framework config (playwright.config.ts or cypress.config.ts) - REQUIRED
Optional Context (BMad-Integrated Mode):
- Story markdown (
{story_file}): User story with acceptance criteria (enhances coverage targeting but NOT required) - Tech spec: Technical specification (provides architectural context)
- Test design: Risk/priority context (P0-P3 alignment)
- PRD: Product requirements (business context)
Optional Context (Standalone Mode):
- Source code: Feature implementation to analyze
- Existing tests: Current test suite for gap analysis
Workflow Variables:
standalone_mode: Can work without BMad artifacts (default: true)story_file: Path to story markdown (optional)target_feature: Feature name or directory to analyze (e.g., "user-authentication" or "src/auth/")target_files: Specific files to analyze (comma-separated paths)test_dir: Directory for test files (default:{project-root}/tests)source_dir: Source code directory (default:{project-root}/src)auto_discover_features: Automatically find features needing tests (default: true)analyze_coverage: Check existing test coverage gaps (default: true)coverage_target: Coverage strategy - "critical-paths", "comprehensive", "selective" (default: "critical-paths")test_levels: Which levels to generate - "e2e,api,component,unit" (default: all)avoid_duplicate_coverage: Don't test same behavior at multiple levels (default: true)include_p0: Include P0 critical path tests (default: true)include_p1: Include P1 high priority tests (default: true)include_p2: Include P2 medium priority tests (default: true)include_p3: Include P3 low priority tests (default: false)use_given_when_then: BDD-style test structure (default: true)one_assertion_per_test: Atomic test design (default: true)network_first: Route interception before navigation (default: true)deterministic_waits: No hard waits or sleeps (default: true)generate_fixtures: Create/enhance fixture architecture (default: true)generate_factories: Create/enhance data factories (default: true)update_helpers: Add utility functions (default: true)use_test_design: Load test-design.md if exists (default: true)use_tech_spec: Load tech-spec.md if exists (default: true)use_prd: Load PRD.md if exists (default: true)update_readme: Update test README with new specs (default: true)update_package_scripts: Add test execution scripts (default: true)output_summary: Path for automation summary (default:{output_folder}/automation-summary.md)max_test_duration: Maximum seconds per test (default: 90)max_file_lines: Maximum lines per test file (default: 300)require_self_cleaning: All tests must clean up data (default: true)auto_load_knowledge: Load relevant knowledge fragments (default: true)run_tests_after_generation: Verify tests pass/fail as expected (default: true)auto_validate: Run generated tests after creation (default: true) NEWauto_heal_failures: Enable automatic healing (default: false, opt-in) NEWmax_healing_iterations: Maximum healing attempts per test (default: 3) NEWfail_on_unhealable: Fail workflow if tests can't be healed (default: false) NEWmark_unhealable_as_fixme: Mark unfixable tests with test.fixme() (default: true) NEWuse_mcp_healing: Use Playwright MCP if available (default: true) NEWhealing_knowledge_fragments: Healing patterns to load (default: "test-healing-patterns,selector-resilience,timing-debugging") NEW
Outputs
Primary Deliverable:
- Automation Summary (
automation-summary.md): Comprehensive report containing:- Execution mode (BMad-Integrated, Standalone, Auto-discover)
- Feature analysis (source files analyzed, coverage gaps)
- Tests created (E2E, API, Component, Unit) with counts and paths
- Infrastructure created (fixtures, factories, helpers)
- Test execution instructions
- Coverage analysis (P0-P3 breakdown, coverage percentage)
- Definition of Done checklist
- Next steps and recommendations
Test Files Created:
- E2E tests (
tests/e2e/{feature-name}.spec.ts): Critical user journeys (P0-P1) - API tests (
tests/api/{feature-name}.api.spec.ts): Business logic and contracts (P1-P2) - Component tests (
tests/component/{ComponentName}.test.tsx): UI behavior (P1-P2) - Unit tests (
tests/unit/{module-name}.test.ts): Pure logic (P2-P3)
Supporting Infrastructure:
- Fixtures (
tests/support/fixtures/{feature}.fixture.ts): Setup/teardown with auto-cleanup - Data factories (
tests/support/factories/{entity}.factory.ts): Random test data using faker - Helpers (
tests/support/helpers/{utility}.ts): Utility functions (waitFor, retry, etc.)
Documentation Updates:
- Test README (
tests/README.md): Test suite overview, execution instructions, priority tagging, patterns - package.json scripts: Test execution commands (test:e2e, test:e2e:p0, test:api, etc.)
Validation Safeguards:
- All tests follow Given-When-Then format
- All tests have priority tags ([P0], [P1], [P2], [P3])
- All tests use data-testid selectors (stable, not CSS classes)
- All tests are self-cleaning (fixtures with auto-cleanup)
- No hard waits or flaky patterns (deterministic)
- Test files under 300 lines (lean and focused)
- Tests run under 1.5 minutes each (fast feedback)
Key Features
Dual-Mode Operation
BMad-Integrated Mode (story available):
- Uses story acceptance criteria for coverage targeting
- Aligns with test-design risk/priority assessment
- Expands ATDD tests with edge cases and negative paths
- Optional - story enhances coverage but not required
Standalone Mode (no story):
- Analyzes source code independently
- Identifies coverage gaps automatically
- Generates tests based on code analysis
- Works with any project (BMad or non-BMad)
Auto-discover Mode (no targets):
- Scans codebase for features needing tests
- Prioritizes features with no coverage
- Generates comprehensive test plan
Avoid Duplicate Coverage
Critical principle: Don't test same behavior at multiple levels
Good coverage strategy:
- E2E: User can login → Dashboard loads (critical happy path only)
- API: POST /auth/login returns correct status codes (variations: 200, 401, 400)
- Component: LoginForm validates input (UI edge cases: empty fields, invalid format)
- Unit: validateEmail() logic (pure function edge cases)
Bad coverage (duplicate):
- E2E: User can login → Dashboard loads
- E2E: User can login with different emails → Dashboard loads (unnecessary duplication)
- API: POST /auth/login returns 200 (already covered in E2E)
Use E2E sparingly for critical paths. Use API/Component/Unit for variations and edge cases.
Healing Capabilities (NEW - Phase 2.5)
automate automatically validates and heals test failures after generation.
Configuration: Controlled by config.tea_use_mcp_enhancements (default: true)
- If true + MCP available → MCP-assisted healing
- If true + MCP unavailable → Pattern-based healing
- If false → No healing, document failures for manual review
Constants: Max 3 healing attempts, unfixable tests marked as test.fixme()
How Healing Works (Default - Pattern-Based):
TEA heals tests using pattern-based analysis by:
- Parsing error messages from test output logs
- Matching patterns against known failure signatures
- Applying fixes from healing knowledge fragments:
test-healing-patterns.md- Common failure patterns (selectors, timing, data, network)selector-resilience.md- Selector refactoring (CSS → data-testid, nth() → filter())timing-debugging.md- Race condition fixes (hard waits → event-based waits)
- Re-running tests to verify fix (max 3 iterations)
- Marking unfixable tests as
test.fixme()with detailed comments
This works well for:
- ✅ Common failure patterns (stale selectors, timing issues, dynamic data)
- ✅ Text-based errors with clear signatures
- ✅ Issues documented in knowledge base
- ✅ Automated CI environments without browser access
What MCP Adds (Interactive Debugging Enhancement):
When Playwright MCP is available, TEA additionally:
-
Debugs failures interactively before applying pattern-based fixes:
- Pause test execution with
playwright_test_debug_test(step through, inspect state) - See visual failure context with
browser_snapshot(screenshot of failure state) - Inspect live DOM with browser tools (find why selector doesn't match)
- Analyze console logs with
browser_console_messages(JS errors, warnings, debug output) - Inspect network activity with
browser_network_requests(failed API calls, CORS errors, timeouts)
- Pause test execution with
-
Enhances pattern-based fixes with real-world data:
- Pattern match identifies issue (e.g., "stale selector")
- MCP discovers actual selector with
browser_generate_locatorfrom live page - TEA applies refined fix using real DOM structure (not just pattern guess)
- Verification happens in browser (see if fix works visually)
-
Catches root causes pattern matching might miss:
- Network failures: MCP shows 500 error on API call (not just timeout)
- JS errors: MCP shows
TypeError: undefinedin console (not just "element not found") - Timing issues: MCP shows loading spinner still visible (not just "selector timeout")
- State problems: MCP shows modal blocking button (not just "not clickable")
Key Benefits of MCP Enhancement:
- ✅ Pattern-based fixes (fast, automated) + MCP verification (accurate, context-aware)
- ✅ Visual debugging: See exactly what user sees when test fails
- ✅ DOM inspection: Discover why selectors don't match (element missing, wrong attributes, dynamic IDs)
- ✅ Network visibility: Identify API failures, slow requests, CORS issues
- ✅ Console analysis: Catch JS errors that break page functionality
- ✅ Robust selectors: Generate locators from actual DOM (role, text, testid hierarchy)
- ✅ Faster iteration: Debug and fix in same browser session (no restart needed)
- ✅ Higher success rate: MCP helps diagnose failures pattern matching can't solve
Example Enhancement Flow:
1. Pattern-based healing identifies issue
→ Error: "Locator '.submit-btn' resolved to 0 elements"
→ Pattern match: Stale selector (CSS class)
→ Suggested fix: Replace with data-testid
2. MCP enhances diagnosis (if available)
→ browser_snapshot shows button exists but has class ".submit-button" (not ".submit-btn")
→ browser_generate_locator finds: button[type="submit"].submit-button
→ browser_console_messages shows no errors
3. TEA applies refined fix
→ await page.locator('button[type="submit"]').click()
→ (More accurate than pattern-based guess)
Healing Modes:
-
MCP-Enhanced Healing (when Playwright MCP available):
- Pattern-based analysis + Interactive debugging
- Visual context with
browser_snapshot - Console log analysis with
browser_console_messages - Network inspection with
browser_network_requests - Live DOM inspection with
browser_generate_locator - Step-by-step debugging with
playwright_test_debug_test
-
Pattern-Based Healing (always available):
- Error message parsing and pattern matching
- Automated fixes from healing knowledge fragments
- Text-based analysis (no visual/DOM inspection)
- Works in CI without browser access
Healing Workflow:
1. Generate tests → Run tests
2. IF pass → Success ✅
3. IF fail AND auto_heal_failures=false → Report failures ⚠️
4. IF fail AND auto_heal_failures=true → Enter healing loop:
a. Identify failure pattern (selector, timing, data, network)
b. Apply automated fix from knowledge base
c. Re-run test (max 3 iterations)
d. IF healed → Success ✅
e. IF unhealable → Mark test.fixme() with detailed comment
Example Healing Outcomes:
// ❌ Original (failing): CSS class selector
await page.locator('.btn-primary').click();
// ✅ Healed: data-testid selector
await page.getByTestId('submit-button').click();
// ❌ Original (failing): Hard wait
await page.waitForTimeout(3000);
// ✅ Healed: Network-first pattern
await page.waitForResponse('**/api/data');
// ❌ Original (failing): Hardcoded ID
await expect(page.getByText('User 123')).toBeVisible();
// ✅ Healed: Regex pattern
await expect(page.getByText(/User \d+/)).toBeVisible();
Unfixable Tests (Marked as test.fixme()):
test.fixme('[P1] should handle complex interaction', async ({ page }) => {
// FIXME: Test healing failed after 3 attempts
// Failure: "Locator 'button[data-action="submit"]' resolved to 0 elements"
// Attempted fixes:
// 1. Replaced with page.getByTestId('submit-button') - still failing
// 2. Replaced with page.getByRole('button', { name: 'Submit' }) - still failing
// 3. Added waitForLoadState('networkidle') - still failing
// Manual investigation needed: Selector may require application code changes
// TODO: Review with team, may need data-testid added to button component
// Original test code...
});
When to Enable Healing:
- ✅ Enable for greenfield projects (catch generated test issues early)
- ✅ Enable for brownfield projects (auto-fix legacy selector patterns)
- ❌ Disable if environment not ready (application not deployed/seeded)
- ❌ Disable if preferring manual review of all generated tests
Healing Report Example:
## Test Healing Report
**Auto-Heal Enabled**: true
**Healing Mode**: Pattern-based
**Iterations Allowed**: 3
### Validation Results
- **Total tests**: 10
- **Passing**: 7
- **Failing**: 3
### Healing Outcomes
**Successfully Healed (2 tests):**
- `tests/e2e/login.spec.ts:15` - Stale selector (CSS class → data-testid)
- `tests/e2e/checkout.spec.ts:42` - Race condition (added network-first interception)
**Unable to Heal (1 test):**
- `tests/e2e/complex-flow.spec.ts:67` - Marked as test.fixme()
- Requires application code changes (add data-testid to component)
### Healing Patterns Applied
- **Selector fixes**: 1
- **Timing fixes**: 1
Graceful Degradation:
- Healing is OPTIONAL (default: disabled)
- Works without Playwright MCP (pattern-based fallback)
- Unfixable tests marked clearly (not silently broken)
- Manual investigation path documented
Recording Mode (NEW - Phase 2.5)
automate can record complex UI interactions instead of AI generation.
Activation: Automatic for complex UI scenarios when config.tea_use_mcp_enhancements is true and MCP available
- Complex scenarios: drag-drop, wizards, multi-page flows
- Fallback: AI generation (silent, automatic)
When to Use Recording Mode:
- ✅ Complex UI interactions (drag-drop, multi-step forms, wizards)
- ✅ Visual workflows (modals, dialogs, animations, transitions)
- ✅ Unclear requirements (exploratory, discovering behavior)
- ✅ Multi-page flows (checkout, registration, onboarding)
- ❌ NOT for simple CRUD (AI generation faster)
- ❌ NOT for API-only tests (no UI to record)
When to Use AI Generation (Default):
- ✅ Clear requirements available
- ✅ Standard patterns (login, CRUD, navigation)
- ✅ Need many tests quickly
- ✅ API/backend tests (no UI interaction)
Recording Workflow (Same as atdd):
1. Set generation_mode: "recording"
2. Use generator_setup_page to init recording
3. For each test scenario:
- Execute with browser_* tools (navigate, click, type, select)
- Add verifications with browser_verify_* tools
- Capture log and generate test file
4. Enhance with knowledge base patterns:
- Given-When-Then structure
- data-testid selectors
- Network-first interception
- Fixtures/factories
5. Validate (run tests if auto_validate enabled)
6. Heal if needed (if auto_heal_failures enabled)
Combination: Recording + Healing:
automate can use BOTH recording and healing together:
- Generate tests via recording (complex flows captured interactively)
- Run tests to validate (auto_validate)
- Heal failures automatically (auto_heal_failures)
This is particularly powerful for brownfield projects where:
- Requirements unclear → Use recording to capture existing behavior
- Application complex → Recording captures nuances AI might miss
- Tests may fail → Healing fixes common issues automatically
Graceful Degradation:
- Recording mode is OPTIONAL (default: AI generation)
- Requires Playwright MCP (falls back to AI if unavailable)
- Works with or without healing enabled
- Same quality output regardless of generation method
Test Level Selection Framework
E2E (End-to-End):
- Critical user journeys (login, checkout, core workflows)
- Multi-system integration
- User-facing acceptance criteria
- Characteristics: High confidence, slow execution, brittle
API (Integration):
- Business logic validation
- Service contracts and data transformations
- Backend integration without UI
- Characteristics: Fast feedback, good balance, stable
Component:
- UI component behavior (buttons, forms, modals)
- Interaction testing (click, hover, keyboard navigation)
- State management within component
- Characteristics: Fast, isolated, granular
Unit:
- Pure business logic and algorithms
- Edge cases and error handling
- Minimal dependencies
- Characteristics: Fastest, most granular
Priority Classification (P0-P3)
P0 (Critical - Every commit):
- Critical user paths that must always work
- Security-critical functionality (auth, permissions)
- Data integrity scenarios
- Run in pre-commit hooks or PR checks
P1 (High - PR to main):
- Important features with high user impact
- Integration points between systems
- Error handling for common failures
- Run before merging to main branch
P2 (Medium - Nightly):
- Edge cases with moderate impact
- Less-critical feature variations
- Performance/load testing
- Run in nightly CI builds
P3 (Low - On-demand):
- Nice-to-have validations
- Rarely-used features
- Exploratory testing scenarios
- Run manually or weekly
Priority tagging enables selective execution:
npm run test:e2e:p0 # Run only P0 tests (critical paths)
npm run test:e2e:p1 # Run P0 + P1 tests (pre-merge)
Given-When-Then Test Structure
All tests follow BDD format for clarity:
test('[P0] should login with valid credentials and load dashboard', async ({ page }) => {
// GIVEN: User is on login page
await page.goto('/login');
// WHEN: User submits valid credentials
await page.fill('[data-testid="email-input"]', 'user@example.com');
await page.fill('[data-testid="password-input"]', 'Password123!');
await page.click('[data-testid="login-button"]');
// THEN: User is redirected to dashboard
await expect(page).toHaveURL('/dashboard');
await expect(page.locator('[data-testid="user-name"]')).toBeVisible();
});
One Assertion Per Test (Atomic Design)
Each test verifies exactly one behavior:
// ✅ CORRECT: One assertion
test('[P0] should display user name', async ({ page }) => {
await expect(page.locator('[data-testid="user-name"]')).toHaveText('John');
});
// ❌ WRONG: Multiple assertions (not atomic)
test('[P0] should display user info', async ({ page }) => {
await expect(page.locator('[data-testid="user-name"]')).toHaveText('John');
await expect(page.locator('[data-testid="user-email"]')).toHaveText('john@example.com');
});
Why? If second assertion fails, you don't know if first is still valid. Split into separate tests for clear failure diagnosis.
Network-First Testing Pattern
Critical pattern to prevent race conditions:
test('should load user dashboard after login', async ({ page }) => {
// CRITICAL: Intercept routes BEFORE navigation
await page.route('**/api/user', (route) =>
route.fulfill({
status: 200,
body: JSON.stringify({ id: 1, name: 'Test User' }),
}),
);
// NOW navigate
await page.goto('/dashboard');
await expect(page.locator('[data-testid="user-name"]')).toHaveText('Test User');
});
Always set up route interception before navigating to pages that make network requests.
Fixture Architecture with Auto-Cleanup
Playwright fixtures with automatic data cleanup:
// tests/support/fixtures/auth.fixture.ts
import { test as base } from '@playwright/test';
import { createUser, deleteUser } from '../factories/user.factory';
export const test = base.extend({
authenticatedUser: async ({ page }, use) => {
// Setup: Create and authenticate user
const user = await createUser();
await page.goto('/login');
await page.fill('[data-testid="email"]', user.email);
await page.fill('[data-testid="password"]', user.password);
await page.click('[data-testid="login-button"]');
await page.waitForURL('/dashboard');
// Provide to test
await use(user);
// Cleanup: Delete user automatically
await deleteUser(user.id);
},
});
Fixture principles:
- Auto-cleanup (always delete created data in teardown)
- Composable (fixtures can use other fixtures)
- Isolated (each test gets fresh data)
- Type-safe with TypeScript
Data Factory Architecture
Use faker for all test data generation:
// tests/support/factories/user.factory.ts
import { faker } from '@faker-js/faker';
export const createUser = (overrides = {}) => ({
id: faker.number.int(),
email: faker.internet.email(),
password: faker.internet.password(),
name: faker.person.fullName(),
role: 'user',
createdAt: faker.date.recent().toISOString(),
...overrides,
});
export const createUsers = (count: number) => Array.from({ length: count }, () => createUser());
// API helper for cleanup
export const deleteUser = async (userId: number) => {
await fetch(`/api/users/${userId}`, { method: 'DELETE' });
};
Factory principles:
- Use faker for random data (no hardcoded values to prevent collisions)
- Support overrides for specific test scenarios
- Generate complete valid objects matching API contracts
- Include helper functions for bulk creation and cleanup
No Page Objects
Do NOT create page object classes. Keep tests simple and direct:
// ✅ CORRECT: Direct test
test('should login', async ({ page }) => {
await page.goto('/login');
await page.fill('[data-testid="email"]', 'user@example.com');
await page.click('[data-testid="login-button"]');
await expect(page).toHaveURL('/dashboard');
});
// ❌ WRONG: Page object abstraction
class LoginPage {
async login(email, password) { ... }
}
Use fixtures for setup/teardown, not page objects for actions.
Deterministic Tests Only
No flaky patterns allowed:
// ❌ WRONG: Hard wait
await page.waitForTimeout(2000);
// ✅ CORRECT: Explicit wait
await page.waitForSelector('[data-testid="user-name"]');
await expect(page.locator('[data-testid="user-name"]')).toBeVisible();
// ❌ WRONG: Conditional flow
if (await element.isVisible()) {
await element.click();
}
// ✅ CORRECT: Deterministic assertion
await expect(element).toBeVisible();
await element.click();
// ❌ WRONG: Try-catch for test logic
try {
await element.click();
} catch (e) {
// Test shouldn't catch errors
}
// ✅ CORRECT: Let test fail if element not found
await element.click();
Integration with Other Workflows
Before this workflow:
- framework workflow: Establish test framework architecture (Playwright/Cypress config, directory structure) - REQUIRED
- test-design workflow: Optional for P0-P3 priority alignment and risk assessment context (BMad-Integrated mode only)
- atdd workflow: Optional - automate expands beyond ATDD tests with edge cases (BMad-Integrated mode only)
After this workflow:
- trace workflow: Update traceability matrix with new test coverage (Phase 1) and make quality gate decision (Phase 2)
- CI pipeline: Run tests in burn-in loop to detect flaky patterns
Coordinates with:
- DEV agent: Tests validate implementation correctness
- Story workflow: Tests cover acceptance criteria (BMad-Integrated mode only)
Important Notes
Works Out of Thin Air
automate does NOT require BMad artifacts:
- Can analyze any codebase independently
- User can point TEA at a feature: "automate tests for src/auth/"
- Works on non-BMad projects
- BMad artifacts (story, tech-spec, PRD) are OPTIONAL enhancements, not requirements
Similar to:
- framework: Can scaffold tests on any project
- ci: Can generate CI config without BMad context
Different from:
- atdd: REQUIRES story with acceptance criteria (halt if missing)
- test-design: REQUIRES PRD/epic context (halt if missing)
- trace (Phase 2): REQUIRES test results for gate decision (halt if missing)
File Size Limits
Keep test files lean (under 300 lines):
- If file exceeds limit, split into multiple files by feature area
- Group related tests in describe blocks
- Extract common setup to fixtures
Quality Standards Enforced
Every test must:
- ✅ Use Given-When-Then format
- ✅ Have clear, descriptive name with priority tag
- ✅ One assertion per test (atomic)
- ✅ No hard waits or sleeps
- ✅ Use data-testid selectors (not CSS classes)
- ✅ Self-cleaning (fixtures with auto-cleanup)
- ✅ Deterministic (no flaky patterns)
- ✅ Fast (under 90 seconds)
Forbidden patterns:
- ❌ Hard waits:
await page.waitForTimeout(2000) - ❌ Conditional flow:
if (await element.isVisible()) { ... } - ❌ Try-catch for test logic
- ❌ Hardcoded test data (use factories with faker)
- ❌ Page objects
- ❌ Shared state between tests
Knowledge Base References
This workflow automatically consults:
- test-levels-framework.md - Test level selection (E2E vs API vs Component vs Unit) with characteristics and use cases
- test-priorities.md - Priority classification (P0-P3) with execution timing and risk alignment
- fixture-architecture.md - Test fixture patterns with setup/teardown and auto-cleanup using Playwright's test.extend()
- data-factories.md - Factory patterns using @faker-js/faker for random test data generation with overrides
- selective-testing.md - Targeted test execution strategies for CI optimization
- ci-burn-in.md - Flaky test detection patterns (10 iterations to catch intermittent failures)
- test-quality.md - Test design principles (Given-When-Then, determinism, isolation, atomic assertions)
Healing Knowledge (If auto_heal_failures enabled):
- test-healing-patterns.md - Common failure patterns and automated fixes (selectors, timing, data, network, hard waits)
- selector-resilience.md - Robust selector strategies and debugging (data-testid hierarchy, filter vs nth, anti-patterns)
- timing-debugging.md - Race condition identification and deterministic wait fixes (network-first, event-based waits)
See tea-index.csv for complete knowledge fragment mapping (22 fragments total).
Example Output
BMad-Integrated Mode
# Automation Summary - User Authentication
**Date:** 2025-10-14
**Story:** Epic 3, Story 5
**Coverage Target:** critical-paths
## Tests Created
### E2E Tests (2 tests, P0-P1)
- `tests/e2e/user-authentication.spec.ts` (87 lines)
- [P0] Login with valid credentials → Dashboard loads
- [P1] Display error for invalid credentials
### API Tests (3 tests, P1-P2)
- `tests/api/auth.api.spec.ts` (102 lines)
- [P1] POST /auth/login - valid credentials → 200 + token
- [P1] POST /auth/login - invalid credentials → 401 + error
- [P2] POST /auth/login - missing fields → 400 + validation
### Component Tests (2 tests, P1)
- `tests/component/LoginForm.test.tsx` (45 lines)
- [P1] Empty fields → submit button disabled
- [P1] Valid input → submit button enabled
## Infrastructure Created
- Fixtures: `tests/support/fixtures/auth.fixture.ts`
- Factories: `tests/support/factories/user.factory.ts`
## Test Execution
```bash
npm run test:e2e # Run all tests
npm run test:e2e:p0 # Critical paths only
npm run test:e2e:p1 # P0 + P1 tests
```
Coverage Analysis
Total: 7 tests (P0: 1, P1: 5, P2: 1) Levels: E2E: 2, API: 3, Component: 2
✅ All acceptance criteria covered ✅ Happy path (E2E + API) ✅ Error cases (API) ✅ UI validation (Component)
### Standalone Mode
```markdown
# Automation Summary - src/auth/
**Date:** 2025-10-14
**Target:** src/auth/ (standalone analysis)
**Coverage Target:** critical-paths
## Feature Analysis
**Source Files Analyzed:**
- `src/auth/login.ts`
- `src/auth/session.ts`
- `src/auth/validation.ts`
**Existing Coverage:** 0 tests found
**Coverage Gaps:**
- ❌ No E2E tests for login flow
- ❌ No API tests for /auth/login endpoint
- ❌ No unit tests for validateEmail()
## Tests Created
{Same structure as BMad-Integrated mode}
## Recommendations
1. **High Priority (P0-P1):**
- Add E2E test for password reset flow
- Add API tests for token refresh endpoint
2. **Medium Priority (P2):**
- Add unit tests for session timeout logic
Ready to continue?