Data cleaning / Ihab F. Ilyas, Xu Chu.
| Author/creator | Ilyas, Ihab F. author. |
| Other author | Chu, Xu, author. |
| Format | Electronic |
| Edition | First edition. |
| Publication | [New York, New York] : Association for Computing Machinery, [2019] |
| Description | 1 online resource (xix, 260 pages) : illustrations. |
| Supplemental Content | Ebook Central |
| Subjects |
| Series | ACM Books, 2374-6777 ; #28 ACM books #28. ^A1287316 |
| Contents | Introduction: Data Cleaning Workflow -- Book Scope -- Outlier Detection: A Taxonomy of Outlier Detection Methods -- Statistics-Based Outlier Detection -- Distance-Based Outlier Detection --- Model-Based Outlier Detection -- Outlier Detection in High-Dimensional Data -- Conclusion -- Data Deduplication: Similarity Metrics -- Predicting Duplicate Pairs -- Clustering -- Blocking for Deduplication -- Distributed Data Deduplication -- Record Fusion and Entity Consolidation -- Human-Involved Data Deduplication -- Data Deduplication Tools -- Conclusion -- Data Transformation: Syntactic Data Transformations -- Semantic Data Transformations -- ETL Tools -- Conclusion -- Data Quality Rule Definition and Discovery: Functional Dependencies -- Conditional Functional Dependencies -- Denial Constraints -- Other Types of Constraints -- Conclusion --Rule-Based Data Cleaning: Violation Detection -- Error Repair -- Conclusion --Machine Learning and Probabilistic Data Cleaning: Machine Learning for Data Deduplication -- Machine Learning for Data Repair -- Data Cleaning for Analytics and Machine Learning --Conclusion and Future Thoughts |
| Summary | "Data quality is one of the most important problems in data management, since dirty data often leads to inaccurate data analytics results and incorrect business decisions. Poor data across businesses and the U.S. government are reported to cost trillions of dollars a year. Multiple surveys show that dirty data is the most common barrier faced by data scientists. Not surprisingly, developing effective and efficient data cleaning solutions is challenging and is rife with deep theoretical and engineering problems. This book is about data cleaning, which is used to refer to all kinds of tasks and activities to detect and repair errors in the data. Rather than focus on a particular data cleaning task, we give an overview of the endto- end data cleaning process, describing various error detection and repair methods, and attempt to anchor these proposals with multiple taxonomies and views. Specifically, we cover four of the most common and important data cleaning tasks, namely, outlier detection, data transformation, error repair (including imputing missing values), and data deduplication. Furthermore, due to the increasing popularity and applicability of machine learning techniques, we include a chapter that specifically explores how machine learning techniques are used for data cleaning, and how data cleaning is used to improve machine learning models. This book is intended to serve as a useful reference for researchers and practitioners who are interested in the area of data quality and data cleaning. It can also be used as a textbook for a graduate course. Although we aim at covering state-of-the-art algorithms and techniques, we recognize that data cleaning is still an active field of research and therefore provide future directions of research whenever appropriate."-- Provided by publisher. |
| Bibliography note | Includes bibliographical references and index. |
| Source of description | Print version record and online resource (ACM Digital Library, viewed July 28, 2020). |
| Issued in other form | Print version: 9781450371537 9781450371520 |
| ISBN | 9781450371551 ebook |
| ISBN | 1450371558 |
| ISBN | 9781450371544 epub |
| ISBN | 145037154X epub |
| ISBN | hardcover |
| ISBN | paperback |
| ISBN | 1450371523 |
| ISBN | 9781450371520 |
| Standard identifier# | 10.1145/3310205 |
Availability
| Library | Location | Call Number | Status | Item Actions |
|---|---|---|---|---|
| Electronic Resources | Access Content Online | ✔ Available |