Next Article in Journal
An Image Encryption Algorithm Based on Improved Hilbert Curve Scrambling and Dynamic DNA Coding
Next Article in Special Issue
Graph Clustering with High-Order Contrastive Learning
Previous Article in Journal
Geometric Insights into the Multivariate Gaussian Distribution and Its Entropy and Mutual Information
Previous Article in Special Issue
Benign and Malignant Breast Tumor Classification in Ultrasound and Mammography Images via Fusion of Deep Learning and Handcraft Features
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Enhancing Image Quality via Robust Noise Filtering Using Redescending M-Estimators

by
Ángel Arturo Rendón-Castro
1,
Dante Mújica-Vargas
1,*,
Antonio Luna-Álvarez
1 and
Jean Marie Vianney Kinani
2
1
Department of Computer Science, Tecnológico Nacional de México/CENIDET, Interior Internado Palmira S/N, Palmira, Cuernavaca 62490, Mexico
2
Unidad Profesional Interdiciplinaria de Ingeniería Campus Hidalgo, Instituto Politécnico Nacional, Pachuca 07738, Mexico
*
Author to whom correspondence should be addressed.
Submission received: 15 May 2023 / Revised: 20 July 2023 / Accepted: 6 August 2023 / Published: 7 August 2023
(This article belongs to the Special Issue Pattern Recognition and Data Clustering in Information Theory)

Abstract

:
In the field of image processing, noise represents an unwanted component that can occur during signal acquisition, transmission, and storage. In this paper, we introduce an efficient method that incorporates redescending M-estimators within the framework of Wiener estimation. The proposed approach effectively suppresses impulsive, additive, and multiplicative noise across varied densities. Our proposed filter operates on both grayscale and color images; it uses local information obtained from the Wiener filter and robust outlier rejection based on Insha and Hampel’s tripartite redescending influence functions. The effectiveness of the proposed method is verified through qualitative and quantitative results, using metrics such as PSNR, MAE, and SSIM.

1. Introduction

Crucial tasks, such as image processing and medical diagnostics through imaging, require the absence of noise and acceptable quality. This necessitates the suppression of noise without deteriorating fine details or suppressing essential data. Image acquisition, storage, and transmission often introduce various types of noise. For most images, the noise mainly comes from additive, multiplicative, and impulsive noise [1]. Additive noise degrades the image due to pixel intensity fluctuations in the 2D space, with each pixel’s degradation characterized by a Gaussian-like distribution (Gaussian noise). Multiplicative noise, also known as speckle noise, is usually generated when images of complex objects are acquired using highly complex waves; it depends on the signal that produces it and it is difficult to eliminate with traditional noise models. Impulsive noise could be modeled by employing fixed intensity pixel values (salt and pepper noise) where some image pixels are altered to 0 or 255 [2,3,4]. This paper proposes a filter designed to process additive, multiplicative, and impulsive noise using redescending M-estimators. The robust functions implemented are Insha and Hampel’s three-part redescending functions, implemented in the context of a Wiener filter due to their advantages in local measures. The proposed work is assessed using PSNR, SSIM, and MAE metrics and compared with four prevalent methods to process the three types of noise.
In this research, our primary motivation for developing this filter using redescending M-estimators stems from the understanding that additive, impulsive, and multiplicative noise are dominant sources of image corruption. Such noise can emerge during image capture and transmission because of uncontrollable environmental factors or sensor-related characteristics. Furthermore, impulsive noise often manifests during image storage and manipulation. Considering these factors collectively, we believe that our proposed application has broad applicability across various fields, with particular significance in the realm of medical imaging. By mitigating the impact of noise, our solution could assist experts in accurately diagnosing potential pathologies in corrupted images influenced by the aforementioned noise types.
The contribution of this research consists of introducing a noise suppression filter based on redescending M-estimators. The filter is supported by robust processing through the theory of redescending M-estimators, which makes it more tolerant to high noise densities. We compare the proposed filter with four popular filters currently used for general noise suppression. The performance of the filter is evaluated through different experiments, using metrics such as PSNR, SSIM, and MAE.
This paper is organized as follows: In Section 2, we introduce the basic concepts required to understand the work. Section 3 presents the proposed denoising filter and its mathematical background. In Section 4, we present the experimental results and a comparative analysis of the image restoration quality using metrics in comparison to other current methods in the literature. Finally, in Section 5, we provide a synopsis of the main results and recommendations for future work.

2. Related Work

Several methods have been developed to address the removal of one or a combination of the three types of noise. For the purposes of this research, these methods can be classified into five major classes [5,6,7]:
1. Additive and multiplicative filtering: This class includes widely used non-local means (NLM)-based filters [8], which estimate the value of a particular pixel by considering information from the entire image, preserving relevant details. It also includes anisotropic diffusion (AD)-based filters [9,10], which adaptively apply a diffusion process based on the local structure of the image. In [9], an anisotropic diffusion coefficient with an image-dependent threshold parameter was proposed for low densities of Gaussian and speckle noise. While in [10], a method for only suppressing speckle noise was proposed, which combines the use of a Canny operator to enhance an anisotropic diffusion equation. Although these filters are good at preserving details, they fail to handle high noise densities and are not robust against impulse noise. Additionally, bilateral-based filters [11,12,13,14] consider both spatial proximity and intensity similarity between pixels, ensuring that nearby pixels have a significant influence on the filtering process. In [11,12], they focus on universal noise suppressors, but they only process Gaussian and impulse noise. Meanwhile, in [13,14], the authors address the optimization and adaptation of the bilateral algorithm to work with color images. This approach, while effective in terms of parameter flexibility and preserving certain edges in images, lacks handling high noise densities, processing multiplicative noise, and certain blurring of details. Another approach involves estimating the noise level by transforming an image into other domains. For example, in [15], a local complexity estimation in the wavelet domain was proposed for MRI denoising. In [16], a collaborative 3D domain transformation was introduced for noise removal. Additionally, in [17], a hidden Markov model was proposed for transforming an image into other spaces and suppressing Gaussian noise. This type of work often leverages the increase/change of information through domain transformation, but image details and noise cannot be completely separated, and certain image characteristics can be lost. One general drawback of the mentioned filters is that they can introduce a certain degree of blurriness in the image. This is due to considering information from the entire image or applying adaptive diffusion processes, which may result in the loss of fine details or the blurring of important edges. This can impact the visual quality and accuracy of the filtered image, especially in areas with sharp intensity or texture changes. Additionally, some of these filters cannot handle high noise densities.
2. Impulsive filtering: This class primarily focuses on nonlinear filters and is commonly addressed through median-based filters, as in [18], where a fuzzy paradigm was also applied. Similarly, iterative mean/median filters were used in the works of Chen [19,20], and robust statistical methods that achieve remarkable results at rejecting atypical data [21], which is a distinctive characteristic of impulsive noise. These filters typically perform well with high noise densities but are limited to only one type of noise, and their computational costs can be exhaustive due to their iterative processing.
3. Neural networks for noise removal: This category encompasses various approaches. For instance, in [22], a model based on deep convolutional neural networks (CNNs) was proposed for removing multiplicative noise. In [23], a complex-valued CNN was applied for Gaussian denoising. In [24], two deep CNNs were combined to leverage more features for image denoising, and batch renormalization was used to address the small mini-batch problem. Furthermore, in [25], Tian et al. introduced a deep CNN with batch renormalization. Additionally, in [26], the same authors worked with a three-stage CNN by incorporating the wavelet transform, which is highly effective for denoising noisy images corrupted by unknown noise. While these methods can achieve excellent results, they often require substantial resources for designing and training, high computational power, overfitting risks, difficulty in internal interpretation, and sensitivity to the quality and quantity of training data. It is worth noting that these approaches typically rely on extensive training databases, although some methods, like Self2self [27], only use a single image for training. However, their training processes can be very slow.
4. Sparse and low-rank models: These models focus on decomposing a matrix into two components, i.e., a low-rank component and a sparse component. The low-rank component can be approximated as the sum of a relatively small number of column vectors, while the “sparse” component refers to the property of having many zero or near-zero elements. These models are achieved through the minimization of an objective function that penalizes the difference between the original matrix and the sum of the low-rank and sparse matrices. In [28,29,30,31], they were applied to hyperspectral images with multiple channels. While these models can work for various types of noise and handle large volumes of data, they also have some limitations. They can be computationally intensive due to the decomposition and reconstruction of the matrices. Additionally, they are sensitive to parameter selection, require appropriate training data, and have limitations in their ability to handle certain types of noise.
5. Robust estimation for filtering: This category involves the application of robust estimation techniques to eliminate impulsive noise. Previous studies have utilized M-estimators. In [32], a median redescending estimator was employed for impulsive denoising in grayscale images. Furthermore, in [33], we extended the median redescending M-estimator for color images, multi-core processing, and random-value impulsive noise. These robust estimations utilize redescending influence functions ( ψ ) for effective impulsive noise elimination. Another approach involves an NLM (non-local means) method for suppressing Gaussian noise using Tukey’s biweight estimation [34].
Therefore, noise suppression represents a challenging task that can be approached from different perspectives. However, the approaches discussed so far often focus on low noise densities and lack the ability to handle all three types of noise. For this reason, in this research, we aim to develop a filter that does not require training and can effectively handle different types of noise, even at high densities. While the primary focus of this research is to contribute to the diversity of approaches in image noise removal methods, we strongly believe in addressing current and future challenges and exploring efficient and adaptable solutions across diverse contexts and applications. Algorithms that go beyond the classes presented in this section offer unique advantages and can serve as valuable complements to enrich the overall research field.

3. Principles

3.1. Noise Models

Noise is considered an unwanted component in signal processing, and it can occur during the capturing, processing, and storage of information [35]. If f is considered a signal, it can be decomposed into a desired component g and an undesired component representing noise q. The most common types of noise are additive noise ( f = g + q ), multiplicative noise ( f = g q ), and impulsive noise ( f = g ( q ) ). These are the types of noise addressed in this work, and their characteristics are summarized in Table 1.

3.2. M-Estimators

The maximum likelihood estimator proposed by Huber in 1964 has been generalized to M estimators, offering reasonable bias and flexibility by treating the mean and median as special cases [37]. M estimators, denoted as T n = T n ( x 1 , , x n ) , minimize the objective function [38,39,40]:
i = 1 n ρ ( x i , T n ) min
Here, T n represents the desired estimate, and ρ is the loss function. The minimization problem can also be expressed as follows:
i = 1 n ψ ( x i , T n )
where ψ ( x , T n ) is the influence function, defined as ψ ( x , T n ) = T n ρ ( x , T n ) . The loss function ρ is assumed to be symmetric and positive definite; it has a unique minimum at zero, and possesses a partial derivative.

3.3. Redescending M-Estimators

A particular type of M-estimator can completely reject extreme values, which implies that their ψ functions decay away from the central region and do not decay near the origin. These are called redescending M-estimators and are defined as [41]:
ψ r ( x ) = { ψ ( x ) = 0 | x | r }
where 0 < r < is the threshold that allows the limits of the influence function to be set. Redescending estimators are designed to vanish outside the central region and settle to zero if the threshold r is reached. Their efficiency is due to function p s i having a high break point and does not entirely ignore moderately large outliers [42]. The estimators used are Hampel’s three-part redescending M-estimator and Insha’s redescending M-estimator, which are discussed below.

3.3.1. Hampel’s Three-Part Redescending

The Hampel M-estimators maintain a strategic approach to address outliers by delineating regions that mirror the effects of outliers to varying extents. The Hampel three-part redescending estimator is the most suitable for mitigating the influence of outliers. In contrast, other M-estimators, such as Huber’s and Tukey’s, do not provide the requisite accuracy to ensure an adequate level of precision when confronting specific outlier types. The function of Hampel’s three-part redescending estimator, seen as a robust measure, can be interpreted as a combination of the l 2 norm and the l 1 norm, excluding outliers; its function ψ is given by:    
ψ H A M ( a , b , r ) ( x i , j ) = x 0 | x | a a · s g n ( x ) a | x | r a · r | x | r b b | x | r 0 0 | x |
The ψ representation of Hampel’s three-part redescending function is shown in Figure 1.

3.3.2. Insha

This estimator covers some drawbacks of the redescending M-estimators and is considered a tool for outlier detection and robust regression [43]. The form and properties of its corresponding ψ function are discussed below:
ρ ( x ) = c 2 4 [ a r c t a n ( x c ) 2 + c 2 + x 2 c 4 + x 4 ] f o r | x | 0
where c is the fit constant; for the i-th observation, variables x i are the residuals scaled over MAD. With respect to x, the following ψ function is obtained:
ψ I ( r ) ( x ) = x · [ 1 + ( x c ) 4 ] 2 f o r | x | 0 .
The graph of the ψ Insha function is shown in Figure 2.

4. Proposed Noise Suppression Filter

Our proposal focuses on eliminating additive and multiplicative noise with the Insha estimator because the normal distribution of these noises can be optimally modeled through this approach. For impulsive noise, Hampel’s three-part estimator is used, which has an adaptive behavior by the MAD component that allows, through its thresholds, the correct suppression of impulsive noise. To make the process more robust, we follow the structure of the Wiener filter. Wiener filtering minimizes the overall mean square error in the inverse filtering and noise smoothing process. Wiener estimates the local mean and variance around each pixel [44].
μ = 1 N M n 1 , n 2 η a ( n 1 , n 2 ) ,
and
σ 2 = 1 N M n 1 , n 2 η a 2 ( n 1 , n 2 ) μ 2 ,
where η is the local N × M neighborhood of each pixel in image X. Wiener creates a per-pixel Wiener filter using these estimates. Using the above measurements, we have the following equation:
b ( n 1 , n 2 ) = μ + σ 2 v 2 ( a ( n 1 , n 2 ) μ ) .
where v 2 is the variance of the noise. If the noise variance is not given, Wiener uses the average of all estimated local variances. Then, considering the above, we rewrite the local means in terms of a redescending estimator:
μ ( x ^ ) = 1 n m i , j ψ ( x )
where x ˜ is the observation of the noisy image and x ^ is the result of the component of the Wiener filter. The local variance is as follows:
ς 2 ( x ^ ) = 1 n m i , j η ψ 2 ( x i j ) μ 2 ( x )
The noise variance is as follows:
v 2 ( x ^ ) = k · m e d { | ψ x i j m e d ( ψ ( x η ) ) | }
where k is a scaling factor for normally distributed data; it uses the reciprocal of the quantile function Φ 1 , while 3/4 represents the portion that covers 50% (between 1/4 and 3/4) of the standard normal cumulative distribution function:
k = 1 Φ 1 3 4 = 1.4826
As a result of the above equations, using a filter with the Wiener structure but operating with the properties of the redescending M-estimator, we have the following:
x ˜ = ψ ( x ) + ς 2 ( x ^ ) v 2 ( x ^ ) ς 2 ( x ^ ) · ( x ψ ( x ) )
The influence function ψ can take the value of Insha = ψ I ( r ) or Hampel = ψ H A M ( a , b , r ) , depending on the noise to be processed. Thus, we combine the two non-parametric methods that allow the elimination of impulsive and multiplicative noise by utilizing a Wiener smoothing procedure and the robustness provided by a redescending M-estimator. The influence functions used are shown in Table 2.

Proposed Algorithm

The basic structure of the filtering process can be seen in the pseudocode Algorithm 1.
Algorithm 1 Robust redescending M-estimator filter.
Require: Noisy image X in grayscale with size N × M .
Ensure: Select an influence function of Table 2, depending on the type of noise.
  1:
for i = 1 to M do  
  2:
    for  j = 1 to N do  
  3:
         μ ( x ^ ) 1 n m i , j ψ ( x )                 ▹ Compute local mean.  
  4:
         ς 2 ( x ^ ) 1 n m i , j η ψ ( x 2 μ 2 ( x ) )         ▹ Compute local variance.  
  5:
         v 2 ( x ^ ) = 1.4823 · m e d { | ψ x m e d ( ψ ( x ) ) | }    ▹ Compute noise variance.  
  6:
         x ˜ = ψ ( x ) + ς 2 ( x ^ ) v 2 ( x ^ ) ς 2 ( x ^ ) · ( x ψ ( x ) )      ▹ Redescending M-estimator.  
  7:
         Y i , j x ˜        ▹ The calculated value is written in the output image.  
  8:
    end for 
  9:
end for
     Output: Filtered image Y with size M × N .

5. Experimentation and Results

The performance of the proposed filter is validated through three tests: standard and medical grayscale image processing, image size and batch processing, color image and video processing.

5.1. Standard and Medical Grayscale Image Processing

In the first instance, this experiment was carried out using quality metrics and test images, such as the standard Lena ( 512 × 512 size), lbox_66720-Afbeelding7 ( 437 × 520 size and abbreviated as e2), mdb332DNORM ( 425 × 390 size and abbreviated as e3), and 00000152_016 ( 272 × 530 size and abbreviated as e4) from the datasets [45,46,47]. In the execution, images were corrupted by additive and multiplicative noise from 0.02 to 0.12 in variance, and impulsive from 0.1 to 0.6. The performance of our filter was compared with four state-of-the-art filtering methods that were highly tested to suppress different kinds of noise, such as non-local means (NLM) [48,49], BM3D [16], bilateral filter [14], trilateral filter [11], and estimate parameters for anisotropic diffusion filtering [50,51]. We programmed the proposed filter in MATLAB via an Intel(R) Core(TM) processor i5-8400 CPU @2.8 GHz with six cores and 32 GB of RAM. The comparative methods for ease were also implemented in MATLAB. The metrics used were the following.
The noise suppressing quality was quantified by using the peak signal-to-noise ratio (PSNR) [52] and structural similarity index (SSIM) [53]; the mean absolute error (MAE) was used to quantify the preservation of the fine details of the image [52]. These three metrics can be determined from the following expressions:
PSNR = 10 · l o g ( m a x ( x ( i , j ) ) ) 2 M S E ,
where MSE is the mean squared error and is determined by:
MSE = 1 M · N i = 1 M j = 1 N [ x ( i , j ) e ^ ( i , j ) ] 2 ,
where M · N represents the image sizes that are analyzed, x ( i , j ) is the original image, and e ^ ( i , j ) is the improved image. The SSIM metric, in a simplified form, is calculated by the following expression:
SSIM ( x , y ) = ( 2 μ x μ y + C 1 ) · ( 2 σ x y + C 2 ) ( μ x 2 μ y 2 + C 1 ) · ( σ x 2 + σ y 2 + C 2 ) ,
where x is the original image, y is the refined image, μ x and μ y are the luminance values, σ x and σ y are the contrast values, and C 1 and C 2 are two constant values. On the other hand, MAE can be computed by:
MAE = 1 M · N i = 1 M j = 1 N [ x ( i , j ) e ^ ( i , j ) ] ,
The results of experimentation with the PSNR, SSIM, and MAE metrics can be observed in Table 3 for the Lena grayscale image. According to the table, we can see that the proposed filter—considering the redescending influence functions at the lowest densities—has a lower-medium performance. However, as the noise density increases, the performance of our proposed filter is more efficient than the comparative filters, above all, for multiplicative noise.
The results can be more easily identified in the graphs of Figure 3. These graphs show the average of the metrics for the four test images using the Insha estimator for additive and multiplicative noise, exhibiting a more tolerant behavior with increasing noise density. On the other hand, for the Hampel estimator, an inverse behavior is observed, as it has a more efficient performance at low densities of impulsive noise. However, as the noise density increases, it becomes more affected.
Figure 4 confirms that the filtered Lena image using redescending functions aligns with the expected metric results. Improved performance is observed at high noise densities for both additive and multiplicative noise with the Insha estimator, while visually, the processed images exhibit better preservation of details. In contrast, the Hampel estimator shows superior results for impulsive noise at low densities.
Figure 5 presents the results for images e2, e3, and e4, demonstrating the effectiveness of the proposed filter in efficiently removing various types of noise from medical images.

5.2. Image Size and Batch Processing

To assess the algorithm’s complexity, the execution times of various algorithms were measured using the resized grayscale Lena image. The results of this experiment are shown in Table 4. The results indicate that the proposed approach has a reasonable execution time compared to the comparative methods. However, it is worth noting that utilizing a GPU is recommended to further accelerate the execution time of the proposed method.
In general, it can be said that the proposed algorithm has a complexity of O ( n 2 ) since it iterates through all the pixels of the image, and for each pixel, a specific calculation is performed depending on the type of noise. However, for the multiplicative and impulsive noise types, better results are usually obtained compared to the compared algorithms.
To validate the effectiveness of our proposed approach, it was implemented on various datasets to assess its performance across different densities of the three types of noise. The datasets used included the mammographic image analysis society digital mammogram database (MIAS) [46], comprising one hundred images, twelve standard grayscale images from BSD68 [54], and fifty images from the dataset of breast ultrasound images (DBUI) [55]. The results obtained for different noise densities demonstrated satisfactory performance across different image types. The results of the highest densities of each noise type are presented in Table 5.

5.3. Color Image and Video Processing

The necessary adjustments were made to implement the filtering algorithms for color images, specifically for images in the RGB color space (red, green, and blue). These adjustments focused on separating the images into their three RGB channels, processing each channel separately, and then recombining the images at the end. From each image, three copies were created with impulsive, additive, and multiplicative noise, respectively. The impulsive noise copies were processed using the Hampel estimator, while the images with additive and multiplicative noise were processed using the Insha estimator. In addition to the proposed filtering algorithms, non-local means (NLM), anisotropic diffusion (AD), bilateral, block-matching, and 3D filtering (BM3D) algorithms were also implemented in the images. Thus, 108 resulting images were obtained from each image.
The fact that three channels of information are now being processed has resulted in an increase in information, which in turn has led to improved performance for the proposed work. For high-density noise experimentation, the standard color images, i.e., Lena, Baboon, Goldhill, Boats, Barbara, and Peppers, were used, along with a positron emission tomography (PET) image. Quantitative results for color image filtering can be seen in Figure 6 for the baboon image and in Figure 7 for brain PET. One can observe how the increase in information benefits the proposed filter, especially for impulsive noise.
An experiment was conducted with algorithms using the color image datasets Kodak24 [56] and CBSD68 [54] at the highest levels of density used in this work. The average results of the three types of noise can be observed in the graphs of Figure 8, where the proposed filter performs better in the SSIM and MAE metrics, and second best in the PSNR metric.
Another additional objective involved processing large batches of images, particularly in videos. For this implementation, a corrupted ultrasound video was used. The formulated NLM and Wiener estimators and algorithms were implemented. The video consists of 687 frames, each with dimensions of 540x360 pixels. Some of these frames can be seen in Figure 9.
To evaluate this implementation, a no-reference image quality metric called the naturalness image quality evaluator (NIQE) was used. NIQE operates exclusively by measuring quantifiable deviations from statistical patterns observed in natural images, without relying on any prior knowledge or information.
In Figure 10, the proposed filter achieved a lower value compared to the others in the proposed work. Having a low value means that the image quality is perceived as good. The NIQE metric is used to evaluate the visual quality of images and provides a numerical score, indicating how close an image is to being perceived as natural by humans. Therefore, a low value in the NIQE metric indicates that the image has good visual quality.

6. Conclusions

This work proposes a robust filter for noise suppression based on redescending M-estimators. The aim is to provide a filter that could restore images from additive, multiplicative and impulsive noise. An application in the medical image field could help experts diagnose possible pathologies better. We propose using two influence functions. The first is the Insha; due to its approximation to a normal distribution, it allows the elimination of additive and multiplicative noise. The second, Hampel’s three-part redescending, was used to suppress impulsive noise. The proposed filter shows better performances compared to MLN and AD filters in terms of PSNR, SSIM, and MAE for high additive and multiplicative noise densities, while for the impulsive noise, the best results were at low densities. Considering the processing of RGB images, positive results were obtained according to the metrics, partly due to the information gain resulting from the three channels. Additionally, in the video processing experiment, a good result was indicated through the NIQE metric. In future work, we will consider that the functions can be improved through iterative processes, implementing a noise detector, and incorporating additional or different robust functions. However, it is important to note that this may come with high computational costs, so we could also focus on exploring parallel processing.

Author Contributions

Formal analysis, Á.A.R.-C., D.M.-V., A.L.-Á. and J.M.V.K.; investigation, Á.A.R.-C., D.M.-V. and A.L.-Á.; methodology, Á.A.R.-C., D.M.-V. and J.M.V.K.; software, Á.A.R.-C., A.L.-Á.; supervision, D.M.-V.; validation, Á.A.R.-C., D.M.-V. and J.M.V.K.; writing—original draft, Á.A.R.-C., D.M.-V. and A.L.-Á.; writing—review and editing, Á.A.R.-C., D.M.-V. and A.L.-Á. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors thank CONACYT and TecNM-CENIDET for their financial support through the project “Delimitación de masas sólidas malignas en mamografías mediante un algoritmo de nodos conectados con el menor ángulo polar”.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Distante, A.; Distante, C. Handbook of Image Processing and Computer Vision; Springer: Cham, Switzerland, 2020. [Google Scholar]
  2. Distante, A.; Distante, C. Handbook of Image Processing and Computer Vision: Volume 2: From Image to Pattern; Springer: Cham, Switzerland, 2020. [Google Scholar]
  3. Bovik, A.C. The Essential Guide to Image Processing; Academic Press: Cambridge, MA, USA, 2009. [Google Scholar]
  4. Astola, J.; Kuosmanen, P. Fundamentals of Nonlinear Digital Filtering; CRC Press: Boca Raton, FL, USA, 2020. [Google Scholar]
  5. Afshari, H.H.; Gadsden, S.A.; Habibi, S. Gaussian filters for parameter and state estimation: A general review of theory and recent trends. Signal Process. 2017, 135, 218–238. [Google Scholar] [CrossRef]
  6. George, G.; Oommen, R.M.; Shelly, S.; Philipose, S.S.; Varghese, A.M. A survey on various median filtering techniques for removal of impulse noise from digital image. In Proceedings of the 2018 Conference on Emerging Devices and Smart Systems (ICEDSS), Tiruchengode, India, 2–3 March 2018; pp. 235–238. [Google Scholar]
  7. Jaybhay, J.; Shastri, R. A study of speckle noise reduction filters. Signal Image Process. Int. J. 2015, 6, 71–80. [Google Scholar] [CrossRef]
  8. Singh, K.; Ranade, S.K.; Singh, C. Comparative performance analysis of various wavelet and nonlocal means based approaches for image denoising. Optik 2017, 131, 423–437. [Google Scholar] [CrossRef]
  9. Gupta, B.; Lamba, S.S. An efficient anisotropic diffusion model for image denoising with edge preservation. Comput. Math. Appl. 2021, 93, 106–119. [Google Scholar]
  10. Zhan, X.; Gan, C.; Ding, Y.; Hu, Y.; Xu, B.; Deng, D.; Liao, S.; Xi, J. Speckle Noise Suppression Based on Empirical Mode Decomposition and Improved Anisotropic Diffusion Equation. Photonics 2022, 9, 611. [Google Scholar] [CrossRef]
  11. Garnett, R.; Huegerich, T.; Chui, C.; He, W. A universal noise removal algorithm with an impulse detector. IEEE Trans. Image Process. 2005, 14, 1747–1754. [Google Scholar] [CrossRef] [Green Version]
  12. Lin, C.H.; Tsai, J.S.; Chiu, C.T. Switching bilateral filter with a texture/noise detector for universal noise removal. IEEE Trans. Image Process. 2010, 19, 2307–2320. [Google Scholar]
  13. Banterle, F.; Corsini, M.; Cignoni, P.; Scopigno, R. A low-memory, straightforward and fast bilateral filter through subsampling in spatial domain. In Computer Graphics Forum; Blackwell Publishing Ltd.: Oxford, UK, 2012; Volume 31, pp. 19–32. [Google Scholar]
  14. Tomasi, C.; Manduchi, R. Bilateral filtering for gray and color images. In Proceedings of the Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271), Bombay, India, 7 January 1998; pp. 839–846. [Google Scholar]
  15. Orea-Flores, I.Y.; Gallegos-Funes, F.J.; Arellano-Reynoso, A. Local complexity estimation based filtering method in wavelet domain for magnetic resonance imaging denoising. Entropy 2019, 21, 401. [Google Scholar] [CrossRef] [Green Version]
  16. Dabov, K.; Foi, A.; Katkovnik, V.; Egiazarian, K. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 2007, 16, 2080–2095. [Google Scholar] [CrossRef]
  17. Khmag, A.; Al Haddad, S.A.R.; Ramlee, R.A.; Kamarudin, N.; Malallah, F.L. Natural image noise removal using nonlocal means and hidden Markov models in transform domain. Vis. Comput. 2018, 34, 1661–1675. [Google Scholar] [CrossRef]
  18. Toh, K.K.V.; Isa, N.A.M. Noise adaptive fuzzy switching median filter for salt-and-pepper noise reduction. IEEE Signal Process. Lett. 2009, 17, 281–284. [Google Scholar] [CrossRef] [Green Version]
  19. Chen, J.; Zhan, Y.; Cao, H.; Xiong, G. Iterative grouping median filter for removal of fixed value impulse noise. IET Image Process. 2019, 13, 946–953. [Google Scholar] [CrossRef]
  20. Chen, F.; Huang, M.; Ma, Z.; Li, Y.; Huang, Q. An iterative weighted-mean filter for removal of high-density salt-and-pepper noise. Symmetry 2020, 12, 1990. [Google Scholar] [CrossRef]
  21. Shevlyakov, G. Highly Efficient Robust and Stable M-Estimates of Location. Mathematics 2021, 9, 105. [Google Scholar] [CrossRef]
  22. Wang, G.; Pan, Z.; Zhang, Z. Deep CNN Denoiser prior for multiplicative noise removal. Multimed. Tools Appl. 2019, 78, 29007–29019. [Google Scholar] [CrossRef]
  23. Quan, Y.; Chen, Y.; Shao, Y.; Teng, H.; Xu, Y.; Ji, H. Image denoising using complex-valued deep CNN. Pattern Recognit. 2021, 111, 107639. [Google Scholar] [CrossRef]
  24. Chang, Y.; Yan, L.; Chen, M.; Fang, H.; Zhong, S. Two-stage convolutional neural network for medical noise removal via image decomposition. IEEE Trans. Instrum. Meas. 2019, 69, 2707–2721. [Google Scholar] [CrossRef]
  25. Tian, C.; Xu, Y.; Zuo, W. Image denoising using deep CNN with batch renormalization. Neural Netw. 2020, 121, 461–473. [Google Scholar] [CrossRef]
  26. Tian, C.; Zheng, M.; Zuo, W.; Zhang, B.; Zhang, Y.; Zhang, D. Multi-stage image denoising with the wavelet transform. Pattern Recognit. 2023, 134, 109050. [Google Scholar] [CrossRef]
  27. Quan, Y.; Chen, M.; Pang, T.; Ji, H. Self2self with dropout: Learning self-supervised denoising from single image. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 1890–1898. [Google Scholar]
  28. Wan, Y.; Ma, A.; He, W.; Zhong, Y. Accurate multi-objective low-rank and sparse model for hyperspectral image denoising method. IEEE Trans. Evol. Comput. 2023, 27, 37–51. [Google Scholar] [CrossRef]
  29. Zhang, H.; Liu, L.; He, W.; Zhang, L. Hyperspectral image denoising with total variation regularization and nonlocal low-rank tensor decomposition. IEEE Trans. Geosci. Remote. Sens. 2019, 58, 3071–3084. [Google Scholar] [CrossRef]
  30. Xie, T.; Li, S.; Sun, B. Hyperspectral images denoising via nonconvex regularized low-rank and sparse matrix decomposition. IEEE Trans. Image Process. 2019, 29, 44–56. [Google Scholar] [CrossRef] [PubMed]
  31. Chang, Y.; Yan, L.; Wu, T.; Zhong, S. Remote sensing image stripe noise removal: From image decomposition perspective. IEEE Trans. Geosci. Remote. Sens. 2016, 54, 7018–7031. [Google Scholar] [CrossRef]
  32. Mújica-Vargas, D.; Gallegos-Funes, F.J.; de Jesús Rubio, J.; Pacheco, J. Impulsive noise filtering using a Median Redescending M-Estimator. Intell. Data Anal. 2017, 21, 739–754. [Google Scholar] [CrossRef]
  33. Mújica-Vargas, D.; Rendón-Castro, A.; Matuz-Cruz, M.; Garcia-Aquino, C. Multi-core Median Redescending M-Estimator for Impulsive Denoising in Color Images. In Mexican Conference on Pattern Recognition; Springer: Cham, Switzerland, 2021; pp. 261–271. [Google Scholar]
  34. Peter, D.J.; Govindan, V.; Mathew, A.T. Nonlocal-means image denoising technique using robust M-estimator. J. Comput. Sci. Technol. 2010, 25, 623–631. [Google Scholar] [CrossRef]
  35. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar]
  36. Rafael, C.G.; Richard, E.W. Digital Image Processing Using MATLAB; Pearson Education: Delhi, India, 2004. [Google Scholar]
  37. Farcomeni, A.; Greco, L. Robust Methods for Data Reduction; CRC Press: Boca Raton, FL, USA, 2016. [Google Scholar]
  38. Pitas, I.; Venetsanopoulos, A.N. Nonlinear Digital Filters: Principles and Applications; Springer: Berlin/Heidelberg, Germany, 1990; Volume 84. [Google Scholar]
  39. Huber, P.J. Robust Statistics; John Wiley & Sons: New York, NY, USA, 1981; Volume 523. [Google Scholar]
  40. Hampel, F.R.; Ronchetti, E.M.; Rousseeuw, P.J.; Stahel, W.A. Robust Statistics: The Approach Based on Influence Functions; John Wiley & Sons: New York, NY, USA, 1986; Volume 196. [Google Scholar]
  41. Frigui, H.; Krishnapuram, R. A robust algorithm for automatic extraction of an unknown number of clusters from noisy data. Pattern Recognit. Lett. 1996, 17, 1223–1232. [Google Scholar] [CrossRef]
  42. Kumar, V.V.; Nanalya, G. Removal of salt and pepper noise using robust M-filter. In Proceedings of the 2016 International Conference on Advanced Communication Control and Computing Technologies (ICACCCT), Ramanathapuram, India, 25–27 May 2016; pp. 175–178. [Google Scholar]
  43. Ullah, I.; Qadir, M.F.; Ali, A. Insha’s redescending M-estimator for robust regression: A comparative study. Pak. J. Stat. Oper. Res. 2006, 2, 135–144. [Google Scholar] [CrossRef] [Green Version]
  44. Chen, J.; Benesty, J.; Huang, Y.; Doclo, S. New insights into the noise reduction Wiener filter. IEEE Trans. Audio, Speech Lang. Process. 2006, 14, 1218–1234. [Google Scholar] [CrossRef] [Green Version]
  45. FUJIFILM Healthcare Europe. Ultrasound Cases Info. 2020. Available online: https://www.ultrasoundcases.info/ (accessed on 11 November 2022).
  46. Suckling. The miniMIAS Database of Mammograms. 2017. Available online: https://www.kaggle.com/kmader/mias-mammography (accessed on 22 November 2020).
  47. Jhon Beltran. Xrays Chest 224 small Aug Less Values Selected. 2018. Available online: https://www.kaggle.com/jbeltranleon/xrays-chest-224-small-aug-less-values-selected (accessed on 22 November 2020).
  48. Buades, A.; Coll, B.; Morel, J.M. A non-local algorithm for image denoising. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA, 20–25 June 2005; Volume 2, pp. 60–65. [Google Scholar]
  49. Immerkaer, J. Fast noise variance estimation. Comput. Vis. Image Underst. 1996, 64, 300–302. [Google Scholar] [CrossRef]
  50. Perona, P.; Malik, J. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 1990, 12, 629–639. [Google Scholar] [CrossRef] [Green Version]
  51. Tsiotsios, C.; Petrou, M. On the choice of the parameters for anisotropic diffusion in image processing. Pattern Recognit. 2013, 46, 1369–1381. [Google Scholar] [CrossRef]
  52. Mújica-Vargas, D.; de Jesús Rubio, J.; Kinani, J.M.V.; Gallegos-Funes, F.J. An efficient nonlinear approach for removing fixed-value impulse noise from grayscale images. J. Real-Time Image Process. 2018, 14, 617–633. [Google Scholar] [CrossRef]
  53. Wang, Z.; Simoncelli, E.P.; Bovik, A.C. Multiscale structural similarity for image quality assessment. In Proceedings of the The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA, 9–12 November 2003; Volume 2, pp. 1398–1402. [Google Scholar]
  54. Martin, D.; Fowlkes, C.; Tal, D.; Malik, J. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV 2001, Vancouver, BC, Canada, 7–14 July 2001; Volume 2, pp. 416–423. [Google Scholar]
  55. Al-Dhabyani, W.; Gomaa, M.; Khaled, H.; Fahmy, A. Dataset of breast ultrasound images. Data Brief 2019, 28, 104863. [Google Scholar] [CrossRef] [PubMed]
  56. Franzen, R. Kodak Lossless True Color Image Suite. Available online: https://r0k.us/graphics/kodak/ (accessed on 10 January 2023).
Figure 1. Graph of Hampel’s three-part redescending function.
Figure 1. Graph of Hampel’s three-part redescending function.
Entropy 25 01176 g001
Figure 2. Graph of the Insha function.
Figure 2. Graph of the Insha function.
Entropy 25 01176 g002
Figure 3. Graphical illustrations of the average results of the metrics for the four test images.
Figure 3. Graphical illustrations of the average results of the metrics for the four test images.
Entropy 25 01176 g003
Figure 4. Qualitative results of the redescending (R), NLM, AD, BM3D, and bilateral Lena image.
Figure 4. Qualitative results of the redescending (R), NLM, AD, BM3D, and bilateral Lena image.
Entropy 25 01176 g004
Figure 5. Results of redescending (R), NLM, and AD for the existing and proposed methods at low noise densities (additive = 0.02, multiplicative = 0.02, and impulsive = 0.1) and high noise densities (additive = 0.12, multiplicative = 0.12, and impulsive = 0.6).
Figure 5. Results of redescending (R), NLM, and AD for the existing and proposed methods at low noise densities (additive = 0.02, multiplicative = 0.02, and impulsive = 0.1) and high noise densities (additive = 0.12, multiplicative = 0.12, and impulsive = 0.6).
Entropy 25 01176 g005
Figure 6. Qualitative results of the redescending (R), NLM, AD, BM3D, and bilateral for the baboon color image.
Figure 6. Qualitative results of the redescending (R), NLM, AD, BM3D, and bilateral for the baboon color image.
Entropy 25 01176 g006
Figure 7. Results of filtering of the brain PET image at high densities.
Figure 7. Results of filtering of the brain PET image at high densities.
Entropy 25 01176 g007
Figure 8. Average results for high noise densities in color datasets Kodak24 and CBSD68.
Figure 8. Average results for high noise densities in color datasets Kodak24 and CBSD68.
Entropy 25 01176 g008
Figure 9. Results of the filtering of a frame from the video ultrasound.
Figure 9. Results of the filtering of a frame from the video ultrasound.
Entropy 25 01176 g009
Figure 10. Graphical illustrations of the NIQE metrics.
Figure 10. Graphical illustrations of the NIQE metrics.
Entropy 25 01176 g010
Table 1. Noise models considered in this work [36].
Table 1. Noise models considered in this work [36].
Noise TypeNameExpression
AdditiveGaussian x ˜ = 1 σ 2 π e ( x μ ) 2 2 σ 2
MultiplicativeSpeckle x ˜ = x + n x ,   n = uniformly distributed random noise
ImpulsiveSalt & Pepper x ˜ = 0 with probability   p / 2 ( pepper ) x i , j with probability   p 1 255 with probability   p / 2 ( salt )
Table 2. Modified influence functions of the redescending M-estimator.
Table 2. Modified influence functions of the redescending M-estimator.
Influence FunctionFormulaeThresholds
Insha ψ I ( r ) ( x ) = x · [ 1 + ( x c ) 4 ] 2 f o r | x | 0 c = k · M e d ( | x ˜ i M e d ( h ) | )
Hampel’s three-part redescending ψ H A M ( a , b , r ) ( x ) = x 0 | x | a a · s g n ( x ) a | x | r a · r | x | r b b | x | r 0 0 | x | r = k · M e d ( | x ˜ i M e d ( h ) | ) , a = 0.15 · r and b = 0.85 · r
Table 3. Restoration results in PSNR, SSIM, and MAE terms for Lena for the proposed method. Additive (A), multiplicative (M), impulsive (I), bilateral (Bi), and trilateral (Tri).
Table 3. Restoration results in PSNR, SSIM, and MAE terms for Lena for the proposed method. Additive (A), multiplicative (M), impulsive (I), bilateral (Bi), and trilateral (Tri).
Noise
Type
Noise
Density
Denoising Method
PSNRSSIMMAE
RNLMADBM3DBiTriRNLMADBM3DBiTriRNLMADBM3DBiTri
A0.0227.7128.3026.6917.06118.27430.450.740.750.650.450.360.740.02270.02230.02080.06750.09800.0323
0.0426.3726.3424.1815.08815.62229.5420.670.660.540.440.320.660.03610.03480.03870.09360.13400.0505
0.0625.3325.0823.0913.92114.18625.2570.620.600.540.440.300.620.04150.04120.04680.11360.15930.0597
0.0824.4824.1622.2813.12313.25024.5140.590.560.500.430.300.570.04670.04700.04860.12980.17870.0682
0.123.7223.3821.4412.51712.58023.7000.560.530.450.430.290.540.05110.05110.05140.14360.19440.0741
0.1222.9922.7721.0012.03012.07223.0110.530.500.510.420.290.480.05540.05630.05430.15590.20740.0816
M0.0229.0130.2430.4618.43323.46023.4250.810.790.820.380.510.790.02270.02230.02080.05380.05380.0323
0.0428.4628.4728.4316.52520.75821.7520.780.720.770.360.450.670.02540.02700.02790.07410.07370.0392
0.0627.9527.5927.3115.39719.16720.2760.750.680.720.350.410.640.02790.03030.03030.08930.08870.0439
0.0827.4626.7226.4314.56918.03320.0450.730.650.700.340.390.610.03010.03340.03240.10260.10150.0484
0.127.0426.0625.7213.93617.16119.8730.710.620.690.340.370.580.03210.03570.03530.11390.11230.0518
0.1226.6725.5925.1213.40916.44219.7420.700.600.660.330.360.750.03390.03820.03630.12440.12210.0554
I0.126.0821.7314.7813.64716.63530.4360.530.400.120.360.360.550.03470.03170.05720.09490.07330.0460
0.221.9622.6513.7411.50313.71328.4560.500.370.240.350.310.540.05020.04710.06620.15090.12540.0683
0.319.0620.2013.2010.34312.05221.4500.470.320.350.350.290.540.06580.06330.07660.19420.17180.0918
0.416.7717.7512.339.47410.83518.5620.450.290.370.350.280.490.08340.07820.08580.23270.21650.1134
0.515.0115.8311.738.8259.94314.9430.390.260.380.350.270.450.10150.09160.09290.26590.25660.1328
0.613.4714.1712.108.3069.20214.2020.350.240.360.340.270.350.12250.10550.10400.29540.29460.1530
Table 4. Average execution times (in seconds) with the increasing image size in the Lena image; bold indicates the fastest and underlined denotes the slowest.
Table 4. Average execution times (in seconds) with the increasing image size in the Lena image; bold indicates the fastest and underlined denotes the slowest.
Algorithm/Size281.7 kB436.1 kB607.9 kB783.9 kB
768 × 7681024 × 10241280 × 10241536 × 1024
Redescending13.7625.5937.6854.52
NLM5.0654.71119.82139.78
AD20.3645.8360.6891.43
BM3D25.6646.8866.8296.16
Bilateral0.090.1430.220.31
Trilateral10.421.5655.7682.45
Table 5. Results of the different datasets with additive noise = 0.12, multiplicative noise = 0.12, and impulsive noise = 0.6.
Table 5. Results of the different datasets with additive noise = 0.12, multiplicative noise = 0.12, and impulsive noise = 0.6.
DatasetNoiseAlgorithmPSNRSSIMMAEDatasetPSNRSSIMMAEDatasetPSNRSSIMMAE
MiasAdditiveRedescending18.430.570.0244BSD6821.370.880.017DBUI21.600.630.017
NLM18.650.580.024221.520.880.01721.710.610.017
AD17.610.550.025118.470.780.01918.740.430.020
BM3D13.330.380.043113.740.500.04113.570.130.042
Bilateral18.230.600.025719.750.820.02119.900.470.021
Trilateral18.110.510.02018.010.770.01622.070.590.017
MultiplicativeRedescending20.650.640.01925.800.950.00925.910.770.009
NLM20.590.710.01823.960.920.01123.070.680.012
AD20.140.680.01822.170.890.01222.110.690.012
BM3D18.700.570.02119.640.820.01820.770.570.016
Bilateral21.110.540.01624.840.930.01125.360.750.010
Trilateral22.980.630.01821.450.790.02222.70.650.014
ImpulsiveRedescending16.410.510.02618.700.800.01615.760.330.035
NLM14.710.340.04015.130.580.03813.870.300.036
AD13.630.290.04111.390.290.04514.180.170.040
BM3D10.540.170.05810.690.240.05710.740.050.057
Bilateral13.660.300.04313.890.430.04218.810.450.017
Trilateral13.970.300.02716.400.550.04122.540.460.014
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Rendón-Castro, Á.A.; Mújica-Vargas, D.; Luna-Álvarez, A.; Vianney Kinani, J.M. Enhancing Image Quality via Robust Noise Filtering Using Redescending M-Estimators. Entropy 2023, 25, 1176. https://0-doi-org.brum.beds.ac.uk/10.3390/e25081176

AMA Style

Rendón-Castro ÁA, Mújica-Vargas D, Luna-Álvarez A, Vianney Kinani JM. Enhancing Image Quality via Robust Noise Filtering Using Redescending M-Estimators. Entropy. 2023; 25(8):1176. https://0-doi-org.brum.beds.ac.uk/10.3390/e25081176

Chicago/Turabian Style

Rendón-Castro, Ángel Arturo, Dante Mújica-Vargas, Antonio Luna-Álvarez, and Jean Marie Vianney Kinani. 2023. "Enhancing Image Quality via Robust Noise Filtering Using Redescending M-Estimators" Entropy 25, no. 8: 1176. https://0-doi-org.brum.beds.ac.uk/10.3390/e25081176

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop