Glossário

Deduplication

Deduplication is the process of recognising that two or more records describe the same entity and deciding what to do with them: merge, cross-reference, or mark as distinct. The hard part is not deleting a duplicate — it is proving that two similar records are in fact the same one.

In practice

What this changes in your master data

Similarity is not identity

Two materials with similar descriptions may be different gauges. A rule that merges on textual similarity alone creates a worse error than the original.

The decision needs a trail

Who merged, on what basis, and when. Without it the merge is irreversible in practice, even if the database allows undoing.

Entry is where it gets solved

Detecting a duplicate at registration costs a fraction of detecting it later, when transactions already point at both.

Questions

Frequently asked questions about this term

Keep going

Related terms

Golden record · Master data · MDM (Master Data Management)