Data Engineering & Platform Daily-Ops Checklist

{"Title":"Data Engineering & Platform Daily-Ops Checklist","IntroductionHtml":"

Use this checklist each shift to keep pipelines reliable, control costs, and triage incidents. Record key metrics, link runbooks, and capture follow-ups so your team can spot trends and act quickly. Submissions are stored for traceability and trend analysis.

","SubmitLabel":"Save daily check","SuccessMessage":"Daily ops checklist saved.","DataType":"data-engineering-daily-ops-checklist","SchemaVersion":"1.0","Fields":[{"Key":"date","Type":"text","Label":"Date","HelpText":"YYYY-MM-DD (or auto-filled)","Required":true},{"Key":"owner","Type":"text","Label":"Run by (team/person)","HelpText":"Team or person responsible today","Required":true},{"Key":"overall_status","Type":"select","Label":"Overall status","HelpText":"High-level assessment of platform health","Required":true,"Options":[{"Value":"ok","Label":"OK"},{"Value":"at-risk","Label":"At Risk"},{"Value":"critical","Label":"Critical"}]},{"Key":"pipelines_ok","Type":"checkbox","Label":"All scheduled pipelines completed successfully","HelpText":"Check if daily/expected runs finished"},{"Key":"failed_pipeline_count","Type":"number","Label":"Number of failed pipeline runs","HelpText":"Enter 0 if none"},{"Key":"late_runs_count","Type":"number","Label":"Number of late runs (by SLA)","HelpText":"Number of runs that missed expected completion time"},{"Key":"max_queue_depth","Type":"number","Label":"Max queue depth observed","HelpText":"Largest queue depth observed during day"},{"Key":"sla_misses","Type":"checkbox","Label":"Any SLA misses requiring action","HelpText":"Check if SLA missed; provide details below"},{"Key":"storage_cost_change_pct","Type":"number","Label":"Storage cost change (%) vs previous day","HelpText":"Positive values indicate increase"},{"Key":"large_datasets_flagged","Type":"textarea","Label":"Flagged datasets affecting cost or retention","HelpText":"List dataset names or buckets, one per line"},{"Key":"retention_reviews_due","Type":"checkbox","Label":"Retention or lifecycle policies requiring review","HelpText":"Check if retention/TTL changes or expirations need attention"},{"Key":"pending_schema_changes","Type":"checkbox","Label":"Pending schema/contract changes announced","HelpText":"Check if there are proposed or deployed schema changes to validate"},{"Key":"incidents_today","Type":"yesno","Label":"Incidents to triage today?","HelpText":"Were there any incidents affecting data freshness, accuracy, or delivery"},{"Key":"incident_ids","Type":"text","Label":"Incident ID(s)","HelpText":"Comma-separated incident identifiers; leave blank if none"},{"Key":"triage_action","Type":"select","Label":"Triage action taken","HelpText":"Select primary action","Options":[{"Value":"investigate","Label":"Investigate"},{"Value":"mitigate","Label":"Mitigate (workaround)"},{"Value":"escalate","Label":"Escalate to SRE/On-call"},{"Value":"resolved","Label":"Resolved"}]},{"Key":"incident_owner","Type":"text","Label":"Incident owner / assignee","HelpText":"Person or team responsible for follow-up"},{"Key":"runbook_links","Type":"textarea","Label":"Runbook links used","HelpText":"Paste URLs for runbooks or playbooks used"},{"Key":"notes","Type":"textarea","Label":"Notes and follow-ups","HelpText":"Any observations, root-cause hypotheses, or actions to schedule"},{"Key":"create_ticket","Type":"yesno","Label":"Create follow-up ticket(s)?","HelpText":"Select yes to create tickets in your system (manual integration required)"},{"Key":"ticket_refs","Type":"text","Label":"Follow-up ticket IDs","HelpText":"Ticket numbers created for follow-up actions"},{"Key":"submitter_email","Type":"text","Label":"Contact email (optional)","HelpText":"Optional email for follow-up or notifications"}]}