Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation

Research output: Contributions to collected editions/worksChapterpeer-review

Standard

Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation. / Mercorelli, Paolo.
New Developments in Mathematics Research. ed. / Natalie L. Clarke; Alex P. Ronson. Nova Science Publishers, Inc., 2012. p. 85-104 (Mathematics Research Developments).

Research output: Contributions to collected editions/worksChapterpeer-review

Harvard

Mercorelli, P 2012, Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation. in NL Clarke & AP Ronson (eds), New Developments in Mathematics Research. Mathematics Research Developments, Nova Science Publishers, Inc., pp. 85-104.

APA

Mercorelli, P. (2012). Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation. In N. L. Clarke, & A. P. Ronson (Eds.), New Developments in Mathematics Research (pp. 85-104). (Mathematics Research Developments). Nova Science Publishers, Inc..

Vancouver

Mercorelli P. Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation. In Clarke NL, Ronson AP, editors, New Developments in Mathematics Research. Nova Science Publishers, Inc. 2012. p. 85-104. (Mathematics Research Developments).

Bibtex

@inbook{aa799ebfc98c482f9193f324c961f3c5,
title = "Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation",
abstract = "The noise detection and the data cleaning find application in data compressions for images and voice as well as in their analysis and recognition, data transmission, data reconciliation, fault detection and in general in all application area of the signal processing and measurements. The content of this paper can offer the possibility to improve the state of the art of all those procedures with denoising methods which use a thresholding technique implying a free thresholding one, running in wavelet packets. The author presents a technique which deals with a free thresholding method related to the on-line peak noise variance estimation even for signals with a small S/N ratio. The second innovative aspect consists of use of wavelet packets which give more elasticity to the technique. The basic idea is to characterize the noise like an incoherent part of the measured signal. It is performed through the wavelet tree by choosing the subspaces where the median value of the wavelet components has minimum. In this sense the proposed median based algorithm can be seen as an entropy function and this analogy is shown. The paper provides to show general properties of the wavelet packets on which the proposed procedure is based. The developed algorithm is totally general even though it is applied by using Haar wavelet packets and it is present in some industrial software platforms to detect sensor outliers because of their easy structure. More, it is currently integrated in the inferential modeling platform of the Advanced Control and Simulation Solution Responsible Unit within ABB{\textquoteright}s (Asea Brown Boveri) industry division.",
keywords = "Data reconciliation, Fault detection, Haar functions, Noise detection, Signal processing, Variance, Wavelets, Wavelets{\textquoteright} packets, Engineering",
author = "Paolo Mercorelli",
year = "2012",
month = jan,
day = "1",
language = "English",
isbn = "9781613242520",
series = "Mathematics Research Developments",
publisher = "Nova Science Publishers, Inc.",
pages = "85--104",
editor = "Clarke, {Natalie L.} and Ronson, {Alex P.}",
booktitle = "New Developments in Mathematics Research",
address = "United States",

}

RIS

TY - CHAP

T1 - Median based algorithm as an entropy function for noise detection in wavelet trees for data reconciliation

AU - Mercorelli, Paolo

PY - 2012/1/1

Y1 - 2012/1/1

N2 - The noise detection and the data cleaning find application in data compressions for images and voice as well as in their analysis and recognition, data transmission, data reconciliation, fault detection and in general in all application area of the signal processing and measurements. The content of this paper can offer the possibility to improve the state of the art of all those procedures with denoising methods which use a thresholding technique implying a free thresholding one, running in wavelet packets. The author presents a technique which deals with a free thresholding method related to the on-line peak noise variance estimation even for signals with a small S/N ratio. The second innovative aspect consists of use of wavelet packets which give more elasticity to the technique. The basic idea is to characterize the noise like an incoherent part of the measured signal. It is performed through the wavelet tree by choosing the subspaces where the median value of the wavelet components has minimum. In this sense the proposed median based algorithm can be seen as an entropy function and this analogy is shown. The paper provides to show general properties of the wavelet packets on which the proposed procedure is based. The developed algorithm is totally general even though it is applied by using Haar wavelet packets and it is present in some industrial software platforms to detect sensor outliers because of their easy structure. More, it is currently integrated in the inferential modeling platform of the Advanced Control and Simulation Solution Responsible Unit within ABB’s (Asea Brown Boveri) industry division.

AB - The noise detection and the data cleaning find application in data compressions for images and voice as well as in their analysis and recognition, data transmission, data reconciliation, fault detection and in general in all application area of the signal processing and measurements. The content of this paper can offer the possibility to improve the state of the art of all those procedures with denoising methods which use a thresholding technique implying a free thresholding one, running in wavelet packets. The author presents a technique which deals with a free thresholding method related to the on-line peak noise variance estimation even for signals with a small S/N ratio. The second innovative aspect consists of use of wavelet packets which give more elasticity to the technique. The basic idea is to characterize the noise like an incoherent part of the measured signal. It is performed through the wavelet tree by choosing the subspaces where the median value of the wavelet components has minimum. In this sense the proposed median based algorithm can be seen as an entropy function and this analogy is shown. The paper provides to show general properties of the wavelet packets on which the proposed procedure is based. The developed algorithm is totally general even though it is applied by using Haar wavelet packets and it is present in some industrial software platforms to detect sensor outliers because of their easy structure. More, it is currently integrated in the inferential modeling platform of the Advanced Control and Simulation Solution Responsible Unit within ABB’s (Asea Brown Boveri) industry division.

KW - Data reconciliation

KW - Fault detection

KW - Haar functions

KW - Noise detection

KW - Signal processing

KW - Variance

KW - Wavelets

KW - Wavelets’ packets

KW - Engineering

UR - http://www.scopus.com/inward/record.url?scp=85048686664&partnerID=8YFLogxK

M3 - Chapter

AN - SCOPUS:85048686664

SN - 9781613242520

SN - 1613242522

T3 - Mathematics Research Developments

SP - 85

EP - 104

BT - New Developments in Mathematics Research

A2 - Clarke, Natalie L.

A2 - Ronson, Alex P.

PB - Nova Science Publishers, Inc.

ER -

Recently viewed

Activities

  1. A Local Feature Extraction Using Biorthogonal Bases for Classification of Embedded Classes of Signals
  2. Contemporary sinusoidal disturbance detection and nano parameters identification using data scaling based on Recursive Least Squares algorithms
  3. Probabilistic and discrete computational methods for studying coherent behavior in flows
  4. Global Text Processing in CSCL with Learning Protocols: A Coding Scheme for Eye Movement Analyses
  5. Detection of tactical patterns using semi-supervised graph neural networks
  6. Principal Ambidexterity: Exploring and Exploiting in dynamic Contexts
  7. Graph Conditional Variational Models: Too Complex for Multiagent Trajectories?
  8. A discrete-time fractional order PI controller for a three phase synchronous motor using an optimal loop shaping Approach
  9. Process Analyses of Grounding in Chat-based CSCL: An Approach for Adaptive Scripting?
  10. Modeling Efficient Grounding in Chat-based CSCL: An Approach for Adaptive Scripting?
  11. Probabilistic and discrete methods for the computational study of coherent behavior in flows
  12. Multi-Agent Path Finding with Kinematic Constraints for Robotic Mobile Fulfillment Systems
  13. Applications of transfer operator methods in fluid dynamics
  14. Model Predictive Control for Switching Gain Adaptation in a Sliding Mode Controller of a DC Drive with Nonlinear Friction
  15. Domestication and/or Digital Divide – How to Overcome Binary Classifications in Analysing Everyday Internet Use and Diffusion
  16. Structure and dynamics laboratory testing of an indirectly controlled full variable valve train for camless engines
  17. Framing Emerging Technologies in Interstitial Issue Fields: Insights from the Blockchain Technology
  18. Computer Simulations in Design. How Social Media meet Computational Methods in Design Processes
  19. Interpreting Strings, Weaving Threads – Structuring Provenance Data with AI
  20. Learner Performance of Language Learning Tasks in Web-Based Environments
  21. SIAM Conference on Applications of Dynamical Systems - DS 2023

Publications

  1. Analyzing multivariate dynamics using cross-recurrence quantification analysis (CRQA), diagonal-cross-recurrence profiles (DCRP), and multidimensional recurrence quantification analysis (MdRQA) - A tutorial in R
  2. Using sequential injection analysis to improve system and data reliability of online methods
  3. Median based algorithm as an entropy function for noise detectionin wavelet trees for data reconciliation
  4. archiDART: a R package allowing root system architecture analysis using Data Analysis of Root Tracings (DART) output files
  5. Wavelet based Fault Detection and RLS Parameter Estimation of Conductive Fibers with a Simultaneous Estimation of Time-Varying Disturbance
  6. Supervised clustering of streaming data for email batch detection
  7. A genetic algorithm for a self-learning parameterization of an aerodynamic part feeding system for high-speed assembly
  8. Using Euler Discrete Approximation to Control an Aggregate Actuator in Camless Engines
  9. Application of non-convex rate dependent gradient plasticity to the modeling and simulation of inelastic microstructure development and inhomogeneous material behavior
  10. Managing Business Process in Distributed Systems: Requirements, Models, and Implementation
  11. Joint entity and relation linking using EARL
  12. Learning Rotation Sensitive Neural Network for Deformed Objects' Detection in Fisheye Images
  13. Dynamic adjustment of dispatching rule parameters in flow shops with sequence-dependent set-up times
  14. Evaluating the construct validity of Objective Personality Tests using a multitrait-multimethod-Multioccasion-(MTMM-MO)-approach
  15. Analyzing different types of moderated method effects in confirmatory factor models for structurally different methods
  16. A coding scheme to analyse global text processing in computer supported collaborative learning: What eye movements can tell us
  17. Binary Random Nets I
  18. Using Natural Language Processing Techniques to Tackle the Construct Identity Problem in Information Systems Research
  19. Ant colony optimization algorithm and artificial immune system applied to a robot route
  20. Development of a Didactic Graphical Simulation Interface on MATLAB for Systems Control
  21. Graph Conditional Variational Models: Too Complex for Multiagent Trajectories?
  22. Analysis of Complexity Reduction in Kalman Filters Through Decoupling Control With Chattered Inputs in PMSM
  23. Towards a Dynamic Interpretation of Subjective and Objective Values
  24. Using protochirons for three-dimensional coding of certain chemical structures.
  25. Adaptive and Dynamic Feedback Loops between Production System and Production Network based on the Asset Administration Shell
  26. Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring