Manual smoke checklist for customer validation

A self-service checklist for validating the release, navigation, policies, evidence, token usage, and observability.

Prerequisites

• Published release deployed
• Test user signed in
• One governed route available

Smoke sequence

1. Day 1: activate the deployment, confirm the app/API version, and open Service Health before inviting the first operators.
2. Confirm Overview, AI Systems → Runtime setup, Help Center, Settings, Policies, Playground, Agent & Tool Governance, and Audit Log are visible to the expected role.
3. Create a template or custom policy and confirm plain-English policy generation is not offered.
4. Run policy simulation and confirm confidence, threshold, and predicted action are visible.
5. Generate one governed event, then confirm Session Timeline, Audit Log, and dashboard cards update.
6. Open Grafana or confirm the service-health error is actionable.
7. Use Help Center search and persona filters to find setup, validation, and troubleshooting guidance.

Validate

• Navigation surfaces visible
• Natural-language policy creation absent
• Confidence details visible
• Grafana or service-health status usable
• Help Center path complete

Next steps

• Record pass/fail notes by route
• Attach request IDs to support tickets
• Schedule office-hours review