Visible to the public BART in Action: Error Generation and Empirical Evaluations of Data-Cleaning Systems

TitleBART in Action: Error Generation and Empirical Evaluations of Data-Cleaning Systems
Publication TypeConference Paper
Year of Publication2016
AuthorsSantoro, Donatello, Arocena, Patricia C., Glavic, Boris, Mecca, Giansalvatore, Miller, Renée J., Papotti, Paolo
Conference NameProceedings of the 2016 International Conference on Management of Data
Date PublishedJune 2016
PublisherACM
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-3531-7
Keywordsdata cleaning, data repairing, empirical evaluation, error generation, pubcrawl170201
Abstract

Repairing erroneous or conflicting data that violate a set of constraints is an important problem in data management. Many automatic or semi-automatic data-repairing algorithms have been proposed in the last few years, each with its own strengths and weaknesses. Bart is an open-source error-generation system conceived to support thorough experimental evaluations of these data-repairing systems. The demo is centered around three main lessons. To start, we discuss how generating errors in data is a complex problem, with several facets. We introduce the important notions of detectability and repairability of an error, that stand at the core of Bart. Then, we show how, by changing the features of errors, it is possible to influence quite significantly the performance of the tools. Finally, we concretely put to work five data-repairing algorithms on dirty data of various kinds generated using Bart, and discuss their performance.

URLhttps://dl.acm.org/doi/10.1145/2882903.2899397
DOI10.1145/2882903.2899397
Citation Keysantoro_bart_2016