Profiling the source before mapping it
Before any mapping document is written, we look at what is actually in the source: null rates, format variation, encoding, how many records share an email address, how consent is really stored versus how it is described. Every migration that overran did so because this step was assumed rather than done.
- Null and completeness rates per field, not per table
- Format and encoding variation, including the rows nobody knew about
- Duplicate analysis against several candidate definitions
- How consent is actually represented — flags, dates, separate tables
- Volume and growth, so the load window can be estimated honestly
- A written statement of what is wrong with the data, for the client to rule on