Reading time: 5 min

26 /2/2019

Selecting the best wavelet for decomposition using Shannon Entropy

Wavelet transform is a pretty awesome signal processing technique to extract time frequency data, however choosing the optimal wavelet to use and best decomposition level often leaves us scratching our heads. Our main intuition in selecting good parameters for wavelet transform often comes down to experience and prior information we have, such as interested frequency bands or similarity of signal shapes with wavelets. However, there are numerous journal papers outlining different approaches to extract these parameters.

In this post, I will focus on best wavelet selection using Shannon Entropy outlined in a journal paper by Yang & Wang (2015).

The general procedure is as follows:

  1. Choose a range of wavelets to compare (e.g db1-8, bior, dmey, sym),
  2. Decompose signal into J levels using either wavelet transform or wavelet packer decomposition,
  3. For approximation and detail components, calculate the relative energy
  4. Determine the Shannon entropy using this equation

    where p_k = E^{i}_{J}/E_T (Relative Energy/Total Energy), N is the number of decomposed details.
  5. Calculate the Shannon entropy to total wavelet energy ratio
  6. Pick the wavelet with the highest ratio.

Let’s go through the procedure step by step in Matlab.

1. Choose a range of wavelets to compare

ratio = {}; 
wav_type ={'db1','db2','db3','db4','db5','db6','db7','db8','db9','db10',... 

2. Decompose signal into J levels using wavelet packet decomposition

signal = signal1.mat; %You will set your own signal data file level = 5; 
%Choose the appropriate decomposition level based on your data
nodeind = 0:2^level-2^(level-1)-1; %node index for wavelet tree for 
wpt = wpdec(signal,level, wavelet{k}, 'shannon');

3. Calculate relative energy for each detail component

E = [];
pk = [];
  for i = 1:length(nodeind) 
    wp_detail = wpcoef(wpt, [level, nodeind(i)]); 
    E(i) = sum(abs(wp_detail).^2);
Et = sum(E);

4. Determine shannon entropy for this level using relative energy

pk = E./Et;
shannon_entropy =  -sum(pk*log(pk)');

5. Calculate Shannon Entropy to Total Energy Ratio

ratio(k,1) = Et/shannon_entropy;
ratio(k,2) = wavelet{k}; 

6.  Pick wavelet with highest ratio

%Sort from largest to smallest
temp_sort = sortrows(ratio,1);
best_wavelet = temp{end,2};

Yang, Q., Wang, J., 2015, Multi-level Wavelet Shannon Entropy-Based Method for Single-Sensor Fault Location, Entropy, Vol.17, pp.7101-7117


Submit a form to get to touch