Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation

Research output: Contributions to collected editions/worksChapterpeer-review

Authors

The noise detection and the data cleaning find application in data compressions for images and voice as well as in their analysis and recognition, data transmission, data reconciliation, fault detection and in general in all application area of the signal processing and measurements. The content of this paper can offer the possibility to improve the state of the art of all those procedures with denoising methods which use a thresholding technique implying a free thresholding one, running in wavelet packets. The author presents a technique which deals with a free thresholding method related to the on-line peak noise variance estimation even for signals with a small S/N ratio. The second innovative aspect consists of use of wavelet packets which give more elasticity to the technique. The basic idea is to characterize the noise like an incoherent part of the measured signal. It is performed through the wavelet tree by choosing the subspaces where the median value of the wavelet components has minimum. In this sense the proposed median based algorithm can be seen as an entropy function and this analogy is shown. The paper provides to show general properties of the wavelet packets on which the proposed procedure is based. The developed algorithm is totally general even though it is applied by using Haar wavelet packets and it is present in some industrial software platforms to detect sensor outliers because of their easy structure. More, it is currently integrated in the inferential modeling platform of the Advanced Control and Simulation Solution Responsible Unit within ABB’s (Asea Brown Boveri) industry division.

Original languageEnglish
Title of host publicationNew Developments in Mathematics Research
EditorsNatalie L. Clarke, Alex P. Ronson
Number of pages20
PublisherNova Science Publishers, Inc.
Publication date01.01.2012
Pages85-104
ISBN (print)9781613242520, 1613242522
ISBN (electronic)9781536117639
Publication statusPublished - 01.01.2012

    Research areas

  • Data reconciliation, Fault detection, Haar functions, Noise detection, Signal processing, Variance, Wavelets, Wavelets’ packets
  • Engineering

Recently viewed

Publications

  1. Median Based Algorithm as an Entropy Function for Noise Detection in Wavelet Trees for Data Reconciliation
  2. Biorthogonal wavelet trees in the classification of embedded signal classes for intelligent sensors using machine learning applications
  3. Comparing data scaling based recursive least squares algorithms with Kalman Filter for nano parameters identification
  4. An adaptive derivative estimator for fault-detection Using a dynamic system with a suboptimal parameter
  5. Fast template match algorithm for spatial object detection using a stereo vision system for autonomous navigation
  6. Analyzing multivariate dynamics using cross-recurrence quantification analysis (CRQA), diagonal-cross-recurrence profiles (DCRP), and multidimensional recurrence quantification analysis (MdRQA) - A tutorial in R
  7. archiDART: a R package allowing root system architecture analysis using Data Analysis of Root Tracings (DART) output files
  8. Database Publishing Without Databases
  9. Agile knowledge graph testing with TESTaLOD
  10. How to get really smart: Modeling retest and training effects in ability testing using computer-generated figural matrix items
  11. Semi-supervised learning for structured output variables
  12. Evolutionary generation of dispatching rule sets for complex dynamic scheduling problems
  13. Different complex word problems require different combinations of cognitive skills
  14. Simultaneous Constrained Adaptive Item Selection for Group-Based Testing
  15. Noise Detection for Biosignals Using an Orthogonal Wavelet Packet Tree Denoising Algorithm
  16. Applying Bayesian Parameter Estimation to A/B Tests in e-Business Applications
  17. Problem structuring for transitions
  18. Diffusion-driven microstructure evolution in OpenCalphad
  19. How to combine collaboration scripts and heuristic worked examples to foster mathematical argumentation - when working memory matters
  20. An Improved Approach to the Semi-Process-Oriented Implementation of Standardised ERP-Systems
  21. Global temporal typing patterns in foreign language writing
  22. Gain Scheduling Controller for Improving Level Control Performance
  23. Retest effects in matrix test performance
  24. Anatomy of Haar Wavelet Filter and Its Implementation for Signal Processing
  25. Template-based Question Answering using Recursive Neural Networks
  26. Sequencing and fading worked examples and collaboration scripts to foster mathematical argumentation - working memory capacity matters for fading
  27. Four Methods to Distinguish between Fractal Dimensions in Time Series through Recurrence Quantification Analysis