Data Management
“The beginning of wisdom is the definition of terms.”
Sidebar
data_quality_management_system:data_quality_issue
This is an old revision of the document!
Data issue
Definition
A data issue is a non-fulfilment of a requirement regarding data quality.
Notes
Generally, a data issue concerns an incorrect data value, but it can be applied to any other data quality dimensions, e.g., completeness and timeliness.
Attributes of a data issue are:
- Description of a data issue
- Classification of a data issue
- Impact, severity/urgency
- Assignment of the data issue to a person who will resolve the data issue
- What is changed, why en how in the resolution of a data issue
- Resolution time/Duration
Synonym(s)
- Data anomalies
- Data error
- Data quality incident
- Defect
- Error
- Nonconformity
Lifecycle
| Phase | Activity | |
|---|---|---|
| Plan | * To detect or identify data issues * To determine if similar data issues exist * To register data issues * To count the number of data issues * To categorize or classify data issues * To diagnose data issues (‘root cause analysis’) * To formulate options for remediation of data issues. * To assess the business impact of data issues (‘severity’) * To prioritize data issues based on business impact (by data owners and data stewards) * To eventually escalate data issues. See figure. | |
| Do | * To eliminate or resolve a data issue (‘correction’, ‘remediation’, ‘scrubbing’ or ‘cleansing’) * To eliminate the cause of a data issue to prevent recurring (‘corrective action’) * To eliminate the cause of a potential data issue (‘preventive action’) * To deal with the consequences of the data issue, e.g., to report data issues to data consumers * To document actions taken. | |
| Check | * To monitor the status of data issues and their resolutions. * To review the effectiveness of corrective and preventive action. | |
| Act | * To adapt corrective and preventive action. |
Characteristics
| Characteristic | Requirements |
|---|---|
| Severity | Data issues are resolved in order of severity. |
Relations
- Managing data issues is part of a data quality management system.
- Preventing data issues is one of the principles of a data quality program.
- Data issues can, e.g., be caused by data entry processes or be caused by an incomplete data migration
- Data issue management is a subject in a data quality service level agreement.
- Data issues are identified by data profiling or by applying data quality rules.
- Data Issues are identified and resolved by data stewards.
- Data Issues can be resolved by data cleansing.
- Data issues are eliminated by corrections.
- Data issues are prevented by corrective actions.
- Possible data issues are prevented by preventive actions.
- The root cause of a data issue can be investigated by data lineage.
- The status of data issues can be tracked in an incident tracking system.
- Data issues can be prevented by data quality rules.
- Data quality monitoring detects and reports data issues.
Data issue escalation path
The figure shows a possible escalation path of data issues.
Figure 2: Data issue escalation path.
Story
A customer of the TradeAll trade company complained that he had been delivered an incorrect item. The sales department reported this incident in the Incident Tracking System, which was assigned to the Data Steward. The Data Steward then went to see how this could have happened. He found that the item number did not match the item description and suspected that this was due to a data entry error. Based on the item number, the products were taken from the warehouse.
He corrected the item number (Correction), but to prevent this kind of error, he took the measure that the entry of items was checked by a second person to prevent more incidents (Corrective Action). He also made sure to check for duplicate item numbers in the database (Corrective Action).. The customer was apologised for the error and the correct article was delivered as soon as possible.
References
DAMA (2017). DAMA-DMBOK. Data Management Body of Knowledge. 2nd Edition. Technics Publications Llc. August 2017. Chapter 13 Data Quality, section 2.7.3 Develop Operational Procedures for Managing Data Issues.
DAMA Dictionary of Data Management. 2nd Edition 2011. Technics Publications, LLC, New Jersey.
ISO 9000:2015. Quality Management Systems – Requirements.
ISO 9001:2015. Quality Management Systems – Fundamentals and vocabulary.
data_quality_management_system/data_quality_issue.1680699380.txt.gz · Last modified: 2024/03/08 13:33 (external edit)