TIBCO MDM Customization Guide - TIBCO Product Documentation

194 Chapter 10 Setting up Data Quality Process|OverviewData Quality is the process used to derive unique, standardized, and completemaster data. Data quality routines ensure that the data entered in a repository is"golden" so that data can be managed appropriately. If data quality is low, therepository contains two or more records for the same logical item, that is, it resultsin duplication of data.To avoid duplicate records, it is often necessary to bring the same logical recordinto a standardized form. Only after this data standardization occurs, you cansuccessfully check for duplicates. This process of standardizing the data is alsoknown as data cleansing.Even after data cleansing, it may sometimes be difficult to determine whether arecord is really new or is actually a variation (that is, a version) of an existingrecord. It may require a mix of automated decisions (for most of the records) andsome human intervention to decide whether a record is new or existing. This isoften not a simple decision. For example, deciding whether two persons are thesame when a reliable or unique ID is missing, is difficult. It, typically, depends onthe nature of the data and, in particular, which attributes are needed foridentification. In case a reliable or unique ID is supplied, de-duplication is notrequired. However, this represents an ideal scenario which rarely occurs in thereal world.TIBCO MDM Customization Guide