Model Deployment & Production Checklist

{ "Title": "Model Deployment & Production Checklist", "IntroductionHtml": "

This checklist helps teams move a trained model into production with standard safeguards. Use the form to record who is responsible, the target environment, short answers for each required check, and links to supporting evidence (tests, reports, runbooks). Saving the checklist stores a timestamped submission that can be reviewed later for audits or continuous improvement.

Instructions: for each item, choose Yes if the check is completed and evidence is attached or linked. Use the notes field to add context or references to tickets, reports, dashboards, or pull requests.

", "SubmitLabel": "Save checklist", "SuccessMessage": "Checklist saved. You can update this submission later as deployment progresses.", "DataType": "model_deployment_checklist_submission", "SchemaVersion": "1.0", "Fields": [ { "Key": "owner_name", "FieldType": "text", "Label": "Responsible owner", "HelpText": "Person accountable for this deployment (name and role).", "Required": true }, { "Key": "owner_email_or_ticket", "FieldType": "text", "Label": "Owner contact / related ticket", "HelpText": "Email, Slack handle, or change/issue ticket ID for follow-up.", "Required": false }, { "Key": "target_environment", "FieldType": "select", "Label": "Target environment", "HelpText": "Where the model will run", "Required": true, "Options": [ { "Value": "staging", "Label": "Staging / Pre-production" }, { "Value": "canary", "Label": "Canary" }, { "Value": "production", "Label": "Production" } ] }, { "Key": "planned_deployment_date", "FieldType": "text", "Label": "Planned deployment date/time", "HelpText": "Local date/time or CI pipeline run identifier.", "Required": false }, { "Key": "business_acceptance", "FieldType": "yesno", "Label": "Business acceptance criteria & owner sign-off", "HelpText": "Has the business owner signed off and are acceptance criteria documented?", "Required": true }, { "Key": "test_data_and_performance", "FieldType": "yesno", "Label": "Test data and performance baselines", "HelpText": "Are test datasets, performance baselines, and regression test results attached or referenced?", "Required": true }, { "Key": "explainability_and_fairness", "FieldType": "yesno", "Label": "Explainability / fairness checks", "HelpText": "Have fairness, bias, and explainability checks been performed and documented?", "Required": true }, { "Key": "monitoring_metrics_and_alerts", "FieldType": "yesno", "Label": "Monitoring metrics and alert thresholds", "HelpText": "Are production metrics defined (accuracy, latency, throughput, data quality) and alerts configured?", "Required": true }, { "Key": "data_contracts", "FieldType": "yesno", "Label": "Data contract verification at input and output", "HelpText": "Are input/output schemas, versions, and validation checks in place and agreed with producers/consumers?", "Required": true }, { "Key": "canary_and_rollout_plan", "FieldType": "yesno", "Label": "Canary and rollout plan", "HelpText": "Is there a staged rollout or canarying plan with traffic splits, metrics to watch, and success criteria?", "Required": true }, { "Key": "retraining_triggers_and_plan", "FieldType": "yesno", "Label": "Retraining triggers and retrain plan", "HelpText": "Are retraining triggers (data drift, performance drop) defined and is there an operational retraining plan?", "Required": true }, { "Key": "observability_and_logging", "FieldType": "yesno", "Label": "Observability & logging", "HelpText": "Are logs, traces, feature-level metrics, and request/response sampling configured for troubleshooting?", "Required": true }, { "Key": "rollback_and_runbook", "FieldType": "yesno", "Label": "Rollback / runbook procedures", "HelpText": "Is there a tested rollback procedure, runbook, and assigned on-call contacts?", "Required": true }, { "Key": "documentation_and_handoff", "FieldType": "yesno", "Label": "Documentation and runbook handoff", "HelpText": "Are deployment docs, runbooks, model cards, and responsible teams documented and handed off to operations/support?", "Required": true }, { "Key": "known_limitations_and_risks", "FieldType": "textarea", "Label": "Known limitations, risks, or compliance notes", "HelpText": "Briefly list known model limitations, data-sensitivity concerns, regulatory notes, or open risks.", "Required": false }, { "Key": "evidence_links", "FieldType": "textarea", "Label": "Links to evidence (tests, dashboards, PRs, tickets)", "HelpText": "Provide links to artifacts that justify Yes answers (test results, monitoring dashboards, PRs, runbook IDs, audit records).", "Required": false }, { "Key": "final_comments", "FieldType": "textarea", "Label": "Additional notes", "HelpText": "Anything else the reviewer should know.", "Required": false } ] }