Data Quality & Observability — Interactive Runbook Templates

{"Title":"Data Quality Runbook — Incident Triage & Remediation","IntroductionHtml":"

Use this interactive runbook when a data quality issue is detected. Capture triage details, follow remediation steps, assign owners, and record outcomes so incidents are resolved faster and learning is preserved.

This form provides guided templates for common failures (missing/late data, schema drift, unexpected volume changes) and a standardized record for SLAs, notifications, and post-incident actions.

","SubmitLabel":"Save Incident Record","SuccessMessage":"Incident saved. Use the incident ID to track updates, link to tickets, and run the post-incident review.","DataType":"DataQualityRunbookIncident","SchemaVersion":"1.0","Fields":[{"Key":"incident_id","Label":"Incident ID","FieldType":"text","Required":true,"HelpText":"Provide a unique identifier (or leave to auto-generate if integrated with an alert/ticket system)."},{"Key":"detection_timestamp","Label":"Detection timestamp (ISO 8601)","FieldType":"text","Required":true,"HelpText":"e.g., 2026-08-26T14:32:00Z"},{"Key":"detected_by","Label":"Detected by","FieldType":"text","Required":true,"HelpText":"Monitoring rule, alerting system, user, or model name."},{"Key":"template","Label":"Runbook Template","FieldType":"select","Required":true,"Options":[{"Value":"missing_or_late","Label":"Missing data / late pipeline run"},{"Value":"schema_drift","Label":"Schema drift / incompatible types"},{"Value":"volume_change","Label":"Unexpected volume change or sudden metric jump"},{"Value":"other","Label":"Other / manual"}],"HelpText":"Select the template that best matches the failure to surface recommended checks."},{"Key":"severity","Label":"Severity","FieldType":"select","Required":true,"Options":[{"Value":"low","Label":"Low"},{"Value":"medium","Label":"Medium"},{"Value":"high","Label":"High"},{"Value":"critical","Label":"Critical"}],"HelpText":"Severity guides escalation, communications, and SLA targets."},{"Key":"affected_datasets","Label":"Affected datasets / tables / topics","FieldType":"textarea","Required":true,"HelpText":"List identifiers and known owners; include lineage hints if available."},{"Key":"affected_metrics","Label":"Affected metrics, reports, or models","FieldType":"textarea","HelpText":"Which KPIs, dashboards, or downstream models are impacted?"},{"Key":"symptom","Label":"Observed symptom / detection signal","FieldType":"textarea","Required":true,"HelpText":"Describe what the alert showed, which metric changed, or what data is missing."},{"Key":"initial_triage","Label":"Initial triage actions taken","FieldType":"checkbox","Options":[{"Value":"acknowledged","Label":"Acknowledged alert in system"},{"Value":"paused_downstream_jobs","Label":"Paused downstream jobs/processes"},{"Value":"rerun_pipeline","Label":"Reran pipeline/job"},{"Value":"applied_snapshot","Label":"Applied previous known-good snapshot"},{"Value":"escalated","Label":"Escalated to on-call/owner"}],"HelpText":"Check actions already performed to avoid duplication."},{"Key":"assigned_owner","Label":"Assigned owner / responder","FieldType":"text","Required":true,"HelpText":"Person or team responsible for remediation and communications."},{"Key":"time_to_ack_hours","Label":"SLA: time to acknowledge (hours)","FieldType":"number","HelpText":"Target hours to acknowledge the incident."},{"Key":"time_to_resolve_hours","Label":"SLA: time to resolve (hours)","FieldType":"number","HelpText":"Target hours to resolve the incident."},{"Key":"runbook_steps_followed","Label":"Runbook steps followed (detailed)","FieldType":"textarea","HelpText":"Step-by-step actions taken, commands, queries, and checkpoints. Include links to logs, queries, or notebooks."},{"Key":"mitigation_applied","Label":"Mitigation applied (temporary or permanent)","FieldType":"textarea","HelpText":"Describe fixes, backfills, patches, configuration changes, or other mitigations."},{"Key":"rollback_required","Label":"Is rollback required?","FieldType":"yesno"},{"Key":"downstream_notifications","Label":"Stakeholders / downstream teams to notify","FieldType":"textarea","HelpText":"List Slack channels, mailing lists, product owners, and customers to contact."},{"Key":"communication_sent","Label":"Communication sent?","FieldType":"yesno","HelpText":"Document where and when notifications were posted and link to messages/tickets."},{"Key":"external_ticket_link","Label":"External ticket or incident link","FieldType":"text","HelpText":"JIRA, ServiceNow, PagerDuty, or other ticket URL if used."},{"Key":"resolution_timestamp","Label":"Resolution timestamp (ISO 8601)","FieldType":"text","HelpText":"When the incident was resolved or reverted."},{"Key":"resolution_summary","Label":"Resolution summary","FieldType":"textarea","HelpText":"What fixed the issue? Include root cause hypothesis and key evidence."},{"Key":"root_cause_analysis_required","Label":"Require full RCA?","FieldType":"yesno"},{"Key":"post_incident_actions","Label":"Post-incident corrective actions and owners","FieldType":"textarea","HelpText":"List permanent fixes, tests, monitoring improvements, and the owners responsible with due dates."},{"Key":"post_incident_deadline","Label":"Post-incident actions due (YYYY-MM-DD)","FieldType":"text"},{"Key":"lessons_learned","Label":"Lessons learned / notes for future","FieldType":"textarea","HelpText":"Suggestions to avoid recurrence and improvements to runbook or monitoring."},{"Key":"post_incident_checklist","Label":"Post-incident root-cause checklist","FieldType":"checkbox","Options":[{"Value":"confirm_lineage","Label":"Confirm upstream lineage and change history"},{"Value":"validate_alerts","Label":"Validate or tune monitoring rules/thresholds"},{"Value":"implement_tests","Label":"Add or update data quality tests"},{"Value":"add_runbook_steps","Label":"Add missing runbook steps or automations"},{"Value":"schedule_rca","Label":"Schedule formal RCA meeting"}],"HelpText":"Typical post-incident items to close the loop."},{"Key":"incident_closed","Label":"Mark incident closed","FieldType":"yesno","HelpText":"Set to yes when all corrective actions are assigned or completed."}]}