MLOps for OT: Deployment & Monitoring Checklist (Interactive)

{"Title":"MLOps for OT: Deployment & Monitoring Checklist","IntroductionHtml":"

This interactive checklist helps teams run short, shop-floor focused experiments and pilots that prove safe, auditable model lifecycle practices for OT. Use it for pre-deployment reviews, canary rollouts, and post-deployment checks. Capture evidence, record thresholds, and save governance artifacts for audits. Adapt thresholds and items to your process and risk profile.

","SubmitLabel":"Save checklist","SuccessMessage":"Checklist saved. You can return to amend entries or export evidence for audits.","DataType":"mlops_ot_deployment_checklist","SchemaVersion":1,"Fields":[{"Key":"model_identifier","Label":"Model identifier & version","FieldType":"text","HelpText":"e.g., model name, version tag, artifact hash or registry path","Required":true},{"Key":"dataset_version","Label":"Training dataset & lineage","FieldType":"textarea","HelpText":"Dataset ID/version, preprocessing notes, feature set, and links to lineage artifacts","Required":true},{"Key":"deployment_type","Label":"Deployment type","FieldType":"select","Options":[{"Value":"canary","Label":"Canary / phased"},{"Value":"full","Label":"Full rollout"},{"Value":"shadow","Label":"Shadow / non-actuating"},{"Value":"testbed","Label":"Testbed only"}],"HelpText":"Choose the rollout approach for this pilot","Required":true},{"Key":"pre_deployment_tests","Label":"Pre-deployment baseline tests executed","FieldType":"yesno","HelpText":"Have unit, integration, safety, and dry-run tests been executed and passed? Attach evidence in Notes."},{"Key":"baseline_metrics","Label":"Baseline performance metrics (summary)","FieldType":"textarea","HelpText":"Record key baseline metrics (e.g., accuracy, precision/recall, latency, false positive rate, throughput) and expected ranges."},{"Key":"canary_size","Label":"Canary size (% of traffic or devices)","FieldType":"number","HelpText":"If deploying canary, what percentage of devices/processes will receive the model? Leave blank if not applicable."},{"Key":"drift_detection_config","Label":"Drift detection enabled","FieldType":"yesno","HelpText":"Is drift detection configured for input distribution and output performance?"},{"Key":"drift_thresholds","Label":"Drift detection thresholds (brief)","FieldType":"textarea","HelpText":"Specify thresholds, statistical tests, evaluation windows, and retrain/alert triggers (e.g., KL-divergence > 0.2 over 24h)."},{"Key":"monitoring_metrics","Label":"Monitoring metrics & SLIs","FieldType":"textarea","HelpText":"List what will be monitored (e.g., prediction distribution, confidence, OEE impact, latency, error rates) and their SLO/SLA targets."},{"Key":"alerting_rules","Label":"Alerting rules & receivers","FieldType":"textarea","HelpText":"Define alerts, severity levels, channels (ops, safety, QA), and response expectations (who, when, escalation)."},{"Key":"rollback_plan","Label":"Rollback and operator-override procedure documented","FieldType":"yesno","HelpText":"Is there a tested automated and a manual rollback/stop procedure?"},{"Key":"rollback_steps","Label":"Rollback steps summary","FieldType":"textarea","HelpText":"Concise steps to revert model version, restore safe defaults, and confirm system state after rollback."},{"Key":"operator_override","Label":"Operator override / HMI reviewed","FieldType":"yesno","HelpText":"Can operators safely override model-driven actions? Are prompts, warnings, and required confirmations clear?"},{"Key":"safety_failsafe_behavior","Label":"Failsafe behaviour defined","FieldType":"textarea","HelpText":"What deterministic safe state will the system enter on model failure or loss of signal?"},{"Key":"audit_artifacts","Label":"Governance & audit artifacts included","FieldType":"checkbox","Options":[{"Value":"versioning_policy","Label":"Versioning policy"},{"Value":"test_reports","Label":"Test reports"},{"Value":"approval_signoff","Label":"Approval signoff"},{"Value":"deployment_logs","Label":"Deployment logs"},{"Value":"monitoring_logs","Label":"Monitoring logs"}],"HelpText":"Select which artifacts are attached or available in the project record."},{"Key":"security_controls","Label":"Security & access control reviewed","FieldType":"yesno","HelpText":"Are model artifacts, credentials, endpoints, and logs access-controlled and logged?"},{"Key":"risk_assessment","Label":"Safety & compliance risk assessment completed","FieldType":"yesno","HelpText":"Has FMEA, HAZOP, or equivalent been completed for the model use-case?"},{"Key":"post_deployment_review","Label":"Post-deployment review schedule","FieldType":"textarea","HelpText":"When is the first review, who will participate, and what metrics/behaviours will be evaluated?"},{"Key":"owner_contact","Label":"Model owner / responsible person","FieldType":"text","HelpText":"Name, role, and contact for escalation (e.g., site ML owner).","Required":true},{"Key":"additional_notes","Label":"Additional notes, exceptions or evidence links","FieldType":"textarea","HelpText":"Links to logs, tickets, dashboards, or attachments. Record deviations from the standard process."}]}