Institutions | About Us | Help | Gaeilge
rian logo

Go Back
Advanced information criterion for environmental data quality assurance
Düsterhus, André; Hense, Andreas
A new method for testing time series of environmental data for internal inconsistencies is presented. The method divides the dataset into several disjunct blocks. By means of a comparison of the blocks' estimated probability density distributions, each block is compared with the others. In order to judge the differences, four different measures are used and compared: Kullback-Leibler Divergence, Jensen-Shannon Divergence, Earth Mover's Distance and the Root Mean Square. By looking at the resulting patterns, conclusions on possible inconsistencies in the data can be drawn. This paper shows some sensitivitiy tests and gives an example for an application to real data. Furthermore, it is shown, in which cases of errors (shift in mean, shift in variance and rounding), which measure performs best.
Keyword(s): environmental data; internal inconsistencies; Kullback-Leibler Divergence; Jensen-Shannon Divergence; Earth Mover's Distance; Root Mean Square; sensitivitiy tests; data measurement
Publication Date:
Type: Journal article
Peer-Reviewed: Yes
Institution: Maynooth University
Citation(s): Düsterhus, André and Hense, Andreas (2012) Advanced information criterion for environmental data quality assurance. Advances in Science and Research, 8 (1). pp. 99-104. ISSN 1992-0628
Publisher(s): Copernicus Publications
File Format(s): other
Related Link(s):
First Indexed: 2020-04-02 06:02:27 Last Updated: 2020-04-02 06:02:27