Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation

Research output: Contributions to collected editions/worksChapterpeer-review

Authors

The noise detection and the data cleaning find application in data compressions for images and voice as well as in their analysis and recognition, data transmission, data reconciliation, fault detection and in general in all application area of the signal processing and measurements. The content of this paper can offer the possibility to improve the state of the art of all those procedures with denoising methods which use a thresholding technique implying a free thresholding one, running in wavelet packets. The author presents a technique which deals with a free thresholding method related to the on-line peak noise variance estimation even for signals with a small S/N ratio. The second innovative aspect consists of use of wavelet packets which give more elasticity to the technique. The basic idea is to characterize the noise like an incoherent part of the measured signal. It is performed through the wavelet tree by choosing the subspaces where the median value of the wavelet components has minimum. In this sense the proposed median based algorithm can be seen as an entropy function and this analogy is shown. The paper provides to show general properties of the wavelet packets on which the proposed procedure is based. The developed algorithm is totally general even though it is applied by using Haar wavelet packets and it is present in some industrial software platforms to detect sensor outliers because of their easy structure. More, it is currently integrated in the inferential modeling platform of the Advanced Control and Simulation Solution Responsible Unit within ABB’s (Asea Brown Boveri) industry division.

Original languageEnglish
Title of host publicationNew Developments in Mathematics Research
EditorsNatalie L. Clarke, Alex P. Ronson
Number of pages20
PublisherNova Science Publishers, Inc.
Publication date01.01.2012
Pages85-104
ISBN (print)9781613242520, 1613242522
ISBN (electronic)9781536117639
Publication statusPublished - 01.01.2012

    Research areas

  • Data reconciliation, Fault detection, Haar functions, Noise detection, Signal processing, Variance, Wavelets, Wavelets’ packets
  • Engineering

Recently viewed

Publications

  1. A Tutorial Introduction to Recurrence Quantification Analysis (RQA) for Keystroke Logging Data
  2. Comparing data scaling based recursive least squares algorithms with Kalman Filter for nano parameters identification
  3. Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation
  4. Analyzing multivariate dynamics using cross-recurrence quantification analysis (CRQA), diagonal-cross-recurrence profiles (DCRP), and multidimensional recurrence quantification analysis (MdRQA) - A tutorial in R
  5. An incomplete and simplifying introduction to linked data
  6. Using sequential injection analysis to improve system and data reliability of online methods
  7. Median based algorithm as an entropy function for noise detectionin wavelet trees for data reconciliation
  8. archiDART: a R package allowing root system architecture analysis using Data Analysis of Root Tracings (DART) output files
  9. Parsing Causal Models – An Instance Segmentation Approach
  10. Insights from classifying visual concepts with multiple kernel learning
  11. Modeling the Clickstream Across Multiple Online Advertising Channels Using a Binary Logit With Bayesian Mixture of Normals
  12. Fostering Circularity: Building a Local Community and Implementing Circular Processes
  13. The scaled boundary finite element method for computational homogenization of heterogeneous media
  14. Setting controller parameters through a minimum strategy with a weighted least squares method
  15. Proceedings of the SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge
  16. Comparing Two Voltage Observers in a Sensorsystem using Repetitive Control
  17. On using the adjacency matrix power method for perception of symmetry and for isomorphism testing of highly intricate graphs.
  18. Using Natural Language Processing Techniques to Tackle the Construct Identity Problem in Information Systems Research
  19. A genetic algorithm for a self-learning parameterization of an aerodynamic part feeding system for high-speed assembly
  20. Global text processing in CSCL with learning protocols
  21. Agile knowledge graph testing with TESTaLOD
  22. Proceedings of the SeMantic Answer Type and Relation Prediction Task at ISWC 2021 Semantic Web Challenge (SMART2021)
  23. Neural Combinatorial Optimization on Heterogeneous Graphs
  24. Selection and Recognition of Statistically Defined Signals in Learning Systems
  25. Application of non-convex rate dependent gradient plasticity to the modeling and simulation of inelastic microstructure development and inhomogeneous material behavior
  26. Enhancing Performance of Level System Modeling with Pseudo-Random Signals
  27. Managing Business Process in Distributed Systems: Requirements, Models, and Implementation
  28. Vision-Based Deep Learning Algorithm for Detecting Potholes
  29. Joint entity and relation linking using EARL
  30. Learning Rotation Sensitive Neural Network for Deformed Objects' Detection in Fisheye Images