← Library
◆ Program · PMOProgram ManagementOctober 25, 2026 · 4 min read

A migration needs reconciled records, not just a completed transfer

A migration can load the expected number of rows while losing a member's identity. Compare the eligible set and the receiving service's actual needs.

Article
Reading time
4 min read
Sections
4
Published
October 25, 2026
LinkedInEmail
In this essay4 sections

The migration dashboard reports 9,500 rows loaded. The approved scope also contains 9,500 memberships. The totals match, yet one member cannot be found and another appears twice.

Data migration reconciliation needs to establish which business records arrived, how they relate to one another, and which changes belong to the comparison period. A completed transfer job answers only part of that question.

Two library colleagues examine archive folders and a laptop beside an archive trolley.

Freeze a comparison basis before comparing totals

Consider a fictional membership service moving records to a new system. At the agreed cut-off, the source contains 10,000 unique membership identities. The business owner has approved 500 exclusions, leaving 9,500 eligible identities.

Preserve the exclusion list and its reason. An exclusion is not simply a record the migration failed to load. Someone must be able to show that it was deliberately outside the agreed scope.

Also establish how changes after the cut-off will be handled. If the source keeps receiving updates while the target is compared with an earlier extract, different values may reflect different observation times. Record the snapshot or equivalent comparison basis, then reconcile subsequent changes separately.

Compare identities, then relationships and values

In this example, the target has 9,500 rows but only 9,499 distinct eligible membership identities. One eligible identity appears twice and a different one is missing.

Comparison Result What it establishes
Eligible source identities 9,500 Expected identity set after approved exclusions
Target rows 9,500 Loaded row count only
Distinct eligible target identities 9,499 One eligible identity remains absent
Duplicate target rows for an eligible identity 1 A duplicate masks the missing record in the total

These are synthetic figures. The example demonstrates why equal totals cannot establish identity completeness.

Next, examine the relationships needed by the service. Can an active membership be associated with the correct person and current entitlement? Are required values mapped consistently? Are dates and statuses interpreted the same way? Select checks from the actual business model rather than treating every column as equally meaningful.

AWS DMS provides row-level validation under supported conditions, with distinct pending and failed states and documented limitations. Such tooling can supply valuable comparison evidence, but its supported keys, data types and workload conditions matter. It does not independently establish that the receiving service can perform the required business task. AWS DMS data validation.

Give each discrepancy a disposition

Keep missing, duplicate, mismatched, excluded and not-yet-compared records separate. Combining them into “exceptions” can conceal whether the team understands the cause.

For each material discrepancy, name the business identity, affected relationship or field, source evidence, proposed correction and authorized owner. Restrict access to the detailed record where it contains personal information.

A fix should be followed by the relevant comparison again. If the mapping itself changes, earlier passes that depended on that mapping need reassessment. Preserve the original result so the receiving team can understand what changed.

Reconcile membership identities and usable records
1. Establish the comparison basis

Freeze the agreed cut-off, eligible source identities and approved exclusions.

Compare the eligible set
2. Check identities, relationships and values

Compare distinct IDs and required relationships; equal row totals alone are insufficient.

Missing, duplicate or mismatched

Retain the discrepancy and obtain an authorized correction; rerun affected comparisons.

Return to record comparison
Resolve every material discrepancy
3. Reconcile later changes separately

Account for updates after the cut-off with their own dated evidence.

Exercise the receiving service
4. Validate the business use and handover

Use reconciled records in scoped tasks and retain unresolved dispositions. Source retirement remains a separate decision.

Compare records at an agreed cut-off and reconcile later changes separately. Passing a load job does not authorize source deletion.

Use the reconciled records in the receiving service

Choose business scenarios that exercise the migrated relationships. In the membership example, locate an eligible member, inspect the correct entitlement and perform a permitted service action. Check an approved exclusion separately so the team can explain why it is absent.

These scenarios complement the record comparison; neither replaces the other. A sample transaction can succeed while thousands of other records remain unexamined. A complete set comparison can pass while the application interprets a status incorrectly.

The service handover should retain the comparison basis, unresolved dispositions and operating owner. Evidence for a successful load does not authorize deleting the source or closing the reconciliation work. Those are separate decisions under the organisation's retention and transition controls.

For the missing member in the opening example, the useful answer is a traceable disposition and a verified correction. “The row count matched” cannot explain where that person's record went.

Tags
data migration completenessprogram managementdata quality

Closing thought and further reading

A migration can load the expected number of rows while losing a member's identity. Compare the eligible set and the receiving service's actual needs.

Share article
LinkedInEmail
Keep reading
View all essays
Program Management

A regional rollout needs local evidence

A working platform does not prove that the next region's service is ready. Separate reusable evidence from the local conditions that still need checking.

4 min read
Program Management

Supplier Service Handover: Let the Receiving Team Run It

A supplier demonstration can hide access and support gaps. Let the receiving team rehearse the service, record interventions and retest before acceptance.

8 min read
Program Management

A Green Dashboard Can Hide an Unmade Decision

A task can be on time while the next milestone remains unready. Report the missing condition where the decision maker can see it.

6 min read
Operating proof
Continue the conversation

Need help applying this to your business?

Explore practical support for payment operations, product decisions, program delivery and AI automation, grounded in the challenges behind this essay.

Explore relevant supportEmail Rizwan
Payments Infrastructure Notes

Interested in future field notes?

Request email updates on payments, product decisions, program delivery and practical AI. Your request goes to my inbox for follow-up.

A request for occasional updates, with no weekly schedule promised.