โšก Onwuachi Control Plane

Runbook โ€” Private Group Migration (Zero-Downtime, Single-Active-UC Model)

Runbook โ€” Private Group Migration (Zero-Downtime, Single-Active-UC Model)

By: Derrick Onwuachi Customer: [Enterprise customer, redacted] Source Environment: UC-A Target Environment: UC-B Constraint: Single-active UC only (no dual event processing)

1. Overview

This runbook defines the controlled migration of a customer group (PG) from one UC environment to another using a staged sync, atomic cutover, and strict state-control model.

Critical constraint: only one UC environment may actively process PG events at any time. There is no event deduplication at the backend/event layer, therefore dual processing is not supported โ€” routing control is the only enforcement mechanism.

2. Backup & Rollback Preparation (Source = Source of Truth)

Required backups:

  1. Group Configuration โ€” GroupDump.xml (authoritative PG definition)
  2. User Data โ€” .../users/${group}
  3. UC Resources โ€” resources, AutoAssistants, HuntGroups, notifications, calendars under .../uc/{resource-type}/${group}
  4. SBC-HTTP (UI / Branding / Integrations) โ€” .../sbc-http/www/${group}, used for chat UI, widgets, branding, embedded integrations
  5. Logs (validation only) โ€” EBS logs under .../logs/${group}; S3 archive is not used for migration or rollback decisions

Rollback package definition โ€” rollback is valid only if the PG has NOT been deleted from the source environment:

3. Pre-Migration (Controlled State + Drift Protection)

Execution window: off-hours maintenance window (customer closed period)

3.1 Source state control โ€” source environment remains active during staging but is placed into a controlled migration window state: no intentional PG configuration changes during the migration window, to prevent drift between the staged copy and the final GroupDump snapshot.

3.2 Pre-cutover delta sync (critical step) โ€” immediately before GroupDump generation, sync latest PG state from source โ†’ target: users, resources (AutoAssistants, HuntGroups, notifications), SBC-HTTP /www/${group}, logs (EBS only). This ensures the target reflects final-state consistency.

3.3 GroupDump generation โ€” generate GroupDump.xml from the source, validate trunk bindings, endpoint mappings, and target-environment compatibility adjustments.

4. Cutover Execution (Atomic Switch)

Step 1 โ€” Import to target. Import GroupDump.xml into target UC Admin. Validate: users/presentities, AutoAssistants, HuntGroups, routing behavior, login/session creation, IVA readiness (if applicable).

Step 2 โ€” Routing cutover (traffic switch). Redirect external dependencies to the target: MMP/event routing, ITSP voice routing (carrier-dependent), DNS updates.

Step 3 โ€” Active processor state. After routing propagation: target = active PG processor, source = no longer receiving PG events (routing removed).

Transitional state exists briefly: PG exists in both environments, but only the target is authoritative.

5. Validation Window (Rollback-Safe Phase)

Do not delete the PG from the source yet. Validate: event ingestion (no duplicates), session creation, voice/IVA functionality, SBC-HTTP UI (/www rendering), logs flowing correctly.

Recommended duration: minimum 30โ€“60 minutes, preferred extended off-hours monitoring.

6. Rollback Procedure (Routing-Based Only)

Rollback is only valid prior to PG deletion. Steps: revert MMP routing, ITSP routing, DNS entries. Result: source resumes processing, target stops receiving traffic.

Notes: no rebuild required if PG not modified post-cutover. Rollback does not recover target-side changes made after import.

7. Finalization (Point of No Return)

After successful validation: delete PG from source (UC Admin โ†’ Private Groups โ†’ Delete โ†’ select PG โ†’ confirm). Outcome: PG fully removed from source, no further event ingestion from source, target becomes sole active processor.

8. Completion Criteria

Migration is complete when: target is the only active PG processor, source PG has been deleted, no duplicate event ingestion observed, all external integrations stable, voice + IVA fully operational.

Key Operational Constraints

System Context

โ† Back to Kb