Next Article in Journal
EEG-Based Seizure Detection Using Variable-Frequency Complex Demodulation and Convolutional Neural Networks
Previous Article in Journal
Evaluating the Feasibility of Euler Angles for Bed-Based Patient Movement Monitoring
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Nearly Linear-Phase 2-D Recursive Digital Filters Design Using Balanced Realization Model Reduction

1
Department of Electrical and Computer Engineering, University of Victoria, Victoria, BC V8P 5C2, Canada
2
Department of Computer Science, Camosun College, Victoria, BC V9E 2C1, Canada
*
Author to whom correspondence should be addressed.
Submission received: 15 September 2023 / Revised: 5 November 2023 / Accepted: 22 November 2023 / Published: 27 November 2023
(This article belongs to the Topic Research on the Application of Digital Signal Processing)

Abstract

:
This paper presents a new method for the design of separable-denominator 2-D IIR filters with nearly linear phase in the passband. The design method is based on a balanced realization model reduction technique. The nearly linear-phase 2-D IIR filter is designed using 2-D model reduction from a linear-phase 2-D FIR filter, which serves as the initial filter. The structured controllability and observability Gramians P s and Q s serve as the foundation for this technique. onal positive-definite matrices that satisfy 2-D Lyapunov equations. An efficient method is used to compute these Gramians by minimizing the traces of P s and Q s under linear matrix inequality (LMI) constraints. The use of these Gramians ensures that the resulting 2-D IIR filter preserves stability and can be implemented using a separable-denominator 2-D filter with fewer coefficients than the original 2-D FIR filter. Numerical examples show that the proposed method compares favorably with existing techniques.

1. Introduction

Two-dimensional (2-D) infinite impulse response (IIR) digital filters have been used in many signal processing applications such as image processing, video signal filtering, satellite image processing, beam filters, X-ray, TV transmission, and biomedical imaging [1,2,3,4,5]. Many methods have been proposed for the design of 2-D IIR digital filters (see, e.g., [6,7,8,9,10]). Some methods used linear programming approaches and mirror-image polynomials for the design of 2-D IIR digital filters with separable and nonseparable denominators (see, e.g., [11,12,13,14]). Optimization is also used for the design of separable and non-separable-denominator 2-D IIR filters [15]. Stability criteria based on the system matrix are also used for the design of separable-denominator 2-D IIR filters [16]. Some methods used genetic algorithms [17,18]. Other methods are based on 2-D FIR filters or use model reduction for the design of 2-D IIR digital filters (see, e.g., [19,20,21,22,23]). 2-D finite impulse response (FIR) digital filters have several advantages. They are simple and involve only localized computations [9]. They are always stable and can have a constant group delay. In comparison to 2-D IIR filters, the fundamental downside is that a high 2-D FIR filter order is frequently needed to meet performance requirements with high selectivity [9]. On the other hand, one of the key challenges in dealing with the construction of nearly linear-phase 2-D IIR filters is stability issues [10]. Some methods confine the filters to having denominators in the form of cascaded low-order factors [10], for which sufficient and necessary stability conditions are available [11,12,24]. Other methods used a state-space approach to investigate the stability of 2-D discrete systems using the sufficiency of the 2-D Lyapunov equation to ensure 2-D stability. Although studying the stability problems in state space might lead to strong stability constraints, it has been shown in [25] that the existence of a positive-definite solution pair to the 2-D Lyapunov equation is a sufficient but not necessary condition for 2-D stability.
For 2-D IIR filters with a separable denominator D ( z 1 , z 2 ) = D 1 ( z 1 ) D 2 ( z 2 ) , the stability is much easier to guarantee than the stability of non-separable-denominator filters [9,26]. Two-dimensional (2-D) IIR filters with separable denominators have received more attention because, in addition to fewer stability constraints, the complexity of the implementation is reduced due to fewer coefficients with a separable denominator than with a nonseparable denominator of the same order [9,27,28]. The process of designing separable filters often results in filters that have high order. For various reasons, it is desirable to replace a high-order filter with a lower-order one to reduce the implementation cost and improve computational efficiency. Many academics have been studying balanced realization model reduction strategies for 2-D digital filters over the past few years as a solution to this challenge, and the findings have been shown to be helpful in the design of digital filters [8,29]. Since the controllability and observability Gramians of the system determine a balanced realization in the main, different types of Gramians can be appropriately described for a given 2-D system. As a result, for a given 2-D discrete system, there are many balanced realization types that result in various balanced approximations [30]. This paper is concerned with a balanced realization model reduction of 2-D digital filters based on the structured controllability Gramian P s and the structured observability Gramian Q s , where P s and Q s R n × n . In other words, to use a balanced truncation, the controllability Gramian P and the observability Gramian Q are needed. Linear matrix inequality (LMI) methods in the MATLAB environment can be employed to compute these Gramians. The theory of LMI has captured the interest of various research communities, particularly those working in the field of control systems [31,32,33]. Given that linear programming problems are easily handled by computers, the idea of LMI and its applications is founded on this fact [34]. Some of the earlier design work using LMI includes the work of Li and Paganini [35], and Vandendorpe [36]. In [36], frequency-weighted balanced and closed-loop balanced truncation are used to solve the same problem. In addition, block-diagonal solutions of LMI are used in model reduction of uncertain systems, where the state partitions correspond to different frequency variables [37]. One of the most important steps in creating a coordinate system with balanced realization is to calculate the leading diagonal block matrices of the Gramians of the supplied 2-D system [38]. There have been many 2-D IIR filter design techniques that satisfy magnitude specifications using various methods [21,22]. The approach proposed in this paper differs in the sense that it ensures almost linear phase in the passband. Methods satisfying such specifications have been few [6,8,14,18,19,20,29,39,40]. The paper introduces a new method for designing nearly linear-phase 2-D IIR filters by leveraging a balanced realization model reduction technique, with a focus on controllability and observability Gramians to ensure stability and reduced coefficients, demonstrating favorable results in numerical examples. The contributions of this paper in the area of 2-D IIR filter design include the emphasis on achieving nearly linear phase in the passband, the use of balanced realization model reduction, the incorporation of 2-D FIR filters, the utilization of structured Gramians, efficient computation method for Gramians through LMIs, stability preservation of the obtained filter, and the reduction of the number of filter coefficients. Additionally, the paper’s comparison with existing techniques highlights its contribution to the field of 2-D IIR filter design.
The paper is organized as follows: In Section 2, the definition of structured controllability and observability Gramians of 2-D discrete systems is presented. Section 3 presents an LMI-based algorithm for computing the structured controllability P s and structured observability Q s Gramians. In Section 4, a design procedure for a balanced realization model reduction technique for separable-denominator 2-D IIR digital filters is proposed. To demonstrate the effectiveness of the suggested approach, several examples, including plane wave filtering using a 2-D fan filter, are provided in Section 5. Section 6 concludes the paper.

2. Gramians of 2-D Discrete Systems

For a given 2-D system, multiple types of Gramians can be specified correctly. Similarly, for a 2-D discrete system, there are various types of balanced realizations that result in various balanced approximations [25,30]. In this section, we are interested in the structured controllability and observability Gramians for 2-D discrete systems. The benefits of using this type of Gramians over the others are that the resulting positive-definite block-diagonal Gramians satisfy the 2-D Lyapunov equation and are, therefore, sufficient for 2-D stability [25]. Further, they can be used to obtain a block-diagonal similarity transformation which will lead, as it will be discussed in Section 4, to a guaranteed stable 2-D reduced-order system. We use an LMI-based algorithm to compute these Gramians where the problem is formulated as a minimization problem that can be solved numerically by minimizing the trace of the Gramians P s and Q s under LMI constraints. Using this algorithm, the Gramians P s R n × n , Q s R n × n are constrained to be positive-definite P s > 0 , Q s > 0 , symmetric P s = P s T , Q s = Q s T , and block-diagonal P s = d i a g ( p 1 , p 2 ) , Q s = d i a g ( q 1 , q 2 ) .
Consider a 2-D discrete state-space system realization Σ = ( A , b , c , d ) described by Roesser’s model [41]:
x h ( i + 1 , j ) x v ( i , j + 1 ) = A 11 A 12 A 21 A 22 x h ( i , j ) x v ( i , j ) + b 1 b 2 u ( i , j )
Ax ( i , j ) + bu ( i , j )
y ( i , j ) = [ c 1 c 2 ] x ( i , j ) + d u ( i , j )
cx ( i , j ) + du ( i , j )
where x h ( i , j ) R m × 1 is the horizontal state vector, x v ( i , j ) R n × 1 is the vertical state vector, u ( i , j ) R is the input, y ( i , j ) R is the output, and A 11 , A 12 , A 21 , A 22 , b 1 , b 2 , c 1 , c 2 , and d are real matrices with appropriate dimensions.
The structured controllability and observability Gramians [30] are defined by the positive-definite solutions P s and Q s of the following Lyapunov inequalities:
A P s A T P s + b b T < 0
A T Q s A Q s + c T c < 0
The matrices P s and Q s are block-diagonal matrices, P s = d i a g ( p 1 , p 2 ) and Q s = d i a g ( q 1 , q 2 ) , representing the solutions to the above Lyapunov inequalities. In the following section, a method to obtain the structural controllability and observability Gramians using LMI will be presented.

3. Proposed Computation Method for Structured Gramians

LMIs’ versatility and computational efficiency for handling a wide range of system design challenges have made them an effective computational design tool in systems and control engineering [32,42,43,44,45].
In general, an LMI has the form:
F ( x ) F 0 + i = 1 m x i F i > 0 ,
where x = ( x 1 , , x m ) is a vector of m real numbers called the decision variables, i.e., x i R m , for i = 0 , , m and F i R n × n are given symmetric matrices. The problem is to determine if there is a vector x that exists and satisfies the matrix inequality.
In [46,47], it has been shown that for certain special cases, the rank minimization problem can be reduced to a semi-definite problem. Under these hypotheses, it is possible to say that the solution can be obtained by solving the associated LMI. One effective heuristic, applicable when the matrix variable is symmetric and positive semi-definite, is to minimize the trace instead of the rank [32,42]. This results in a semi-definite problem (SDP), which can be efficiently solved. This heuristic obviously does not apply to problems in which the matrix is non-square, since the trace is not even defined [32,42,48]. In the following, we use an LMI-based algorithm to compute the Gramian matrices P s and Q s of a 2-D discrete system represented by Roesser’s model.
Given a 2-D system in state-space form represented by Roesser’s model Σ = ( A , b , c , d ) , then the block-diagonal positive-definite solutions P s and Q s of the Lyapunov inequalities given by (5) and (6) are the structured controllability and structured observability Gramians. The existence of such P s and Q s ensures the stability of the system Σ , but the converse does not hold, as shown in [6,25]. Finding P s and Q s satisfying (5) and (6) can be solved by formulating an optimization problem using the traces of P s and Q s .
Given a 2-D system realization Σ = ( A , b , c , d ) , one can find P s by minimizing
m i n t r ( P s )
subject to
A P s A T P s + b b T < 0
P s > 0
P s = P s T P s = d i a g ( p 1 , p 2 )
and
m i n t r ( Q s )
subject to
A T Q s A Q s + c T c < 0
Q s > 0
Q s = Q s T Q s = d i a g ( q 1 , q 2 )
This problem can be solved as a linear objective minimization problem under LMI constraints. The controllability and observability Gramian matrices P s and Q s obtained by using this method are block-diagonal positive-definite matrices.
We refer the reader to Appendix A, where several numerical examples, including separable and non-separable-denominator 2-D systems, are presented. These examples illustrate the use of the LMI to solve 2-D Lyapunov inequalities.

4. Balanced Realization/Truncation Technique for 2-D IIR Digital Filters

Balanced realizations are known to be useful realizations for model reduction. The internally balanced realization gives an indication of the dominance of the system states in the input/output behavior [49]. The idea of a balanced realization model reduction, in general, is to remove from the system matrices the blocks corresponding to the smaller Hankel singular values [19,20,50,51]. In the following section, we present the design procedures for nearly linear-phase 2-D IIR digital filters with separable denominators.

Design Procedures

For a 2-D IIR filter with a separable denominator, it is assumed that either A 12 = 0 or A 21 = 0 . The design steps proposed for this type of 2-D filter are described as follows:
  • Design a linear-phase 2-D FIR digital filter that approximates the required frequency response.
  • Realize the designed 2-D FIR filter H ( z 1 , z 2 ) in state space using Roesser’s model [6,41] as follows:
    X h ( i + 1 , j ) X v ( i , j + 1 ) = A 11 A 12 A 21 A 22 x h ( i , j ) x v ( i , j ) + b 1 b 2 u ( i , j )
    y ( i , j ) = c 1 c 2 x h ( i , j ) x v ( i , j ) + d u ( i , j ) ,
    where A 11 , A 12 , A 21 , A 22 , b 1 , b 2 , c 1 , c 2 , and d are real matrices.
  • Compute the structured controllability Gramian P s and the structured observability Gramian Q s using the LMI-based algorithm proposed in Section 3. Note that since either A 12 or A 21 is zero, the equations are simplified and the computational cost of these Gramians is reduced. The obtained structured controllability and structured observability Gramians are block-diagonal matrices, i.e., P s = d i a g ( p 1 , p 2 ) and Q s = d i a g ( q 1 , q 2 ) .
  • Find the invertible matrices T 1 and T 2 such that
    T i 1 p i ( T i 1 ) T = Σ i = T i T q i T i = d i a g ( σ 1 i , σ 2 i , σ n i i ) , i = 1 , 2 .
    • Compute the matrices M 1 i = p i q i , i = 1 , 2 .
    • Decompose the matrices M 1 i as [ u i , s i , v i ] = s v d ( M 1 i ) , i = 1 , 2 .
      where the full singular value decomposition of an m-by-n matrix M involves:
      •  m-by-m matrix u.
      •  m-by-n matrix s.
      •  n-by-n matrix v.
    • Compute the matrices T i = u i s i , i = 1 , 2 .
  • Obtain the similarity transformation matrix
    T : = d i a g ( T 1 , T 2 ) .
  • Form the balanced realization model Σ b = ( T 1 A T , T 1 b , c T ) .
  • Obtain the reduced-order ( r 1 , r 2 ) filter by partitioning the balanced realization obtained in the above step Σ r = ( A r , b r , c r ) .
Figure 1 shows the flowchart of the proposed method.
The following section provides some design examples and a discussion of the implementation and evaluation details of this algorithm.

5. Illustrative Examples and Numerical Evaluation

In this section, we present several design examples to illustrate the effectiveness of the proposed method. In these examples, 2-D FIR lowpass, bandstop, and fan digital filters are first designed using window methods, and then the reduced-order 2-D IIR filters are obtained by using the proposed method. The implementation of the resulting filter designs is investigated and evaluated with respect to the maximum ripple in the passband region Δ p , the maximum ripple in the stopband region Δ s , the maximum ripple of the group delay in the passband region Δ τ , and the number of arithmetic operations.

5.1. 2-D Lowpass Filters

For the sake of comparison, we carried out a study of an example of separable-denominator 2-D IIR lowpass filter with nearly linear phase in the passband. This example was presented by Xiao and Agathoklis in [6], where it is required to design a 2-D lowpass filter to satisfy the following specifications:
H ( ω 1 , ω 2 ) = 1 ω 1 2 + ω 2 2 ω p 2 0 ω 1 2 + ω 2 2 ω s 2
where the passband edge ω p = 0.4 π and the stopband edge ω s = 0.6 π . First, the linear-phase 2-D FIR filter prototype of order (24,24) was designed using the window method. After that, the proposed algorithm is guaranteed to obtain a stable 2-D IIR filter with nearly linear phase in the passband. The solution was computable in a reasonable amount of time on a PC with an Intel (R) Core (TM) i5-2450M CPU @ 2.50 GHz and RAM of 6.00 GB. The computation time for the controllability Gramian P s and the observability Gramian Q s was 7.46 s. The magnitude response of the full-order, (24,24), 2-D FIR lowpass filter is shown in Figure 2a. Figure 2b shows the magnitude response of the reduced-order (13,13) 2-D IIR filter presented in [6]. Figure 2c shows the magnitude response of the reduced-order (13,13) 2-D IIR filter using the proposed method. The magnitude contour of the obtained filter is shown in Figure 2d. Figure 2e,f show the passband group delays, τ 1 = τ 2 12 samples, of the reduced-order 2-D IIR filter. Table 1 summarizes the results of the filter designed by the proposed method, the filter presented in [6], and the results of the filter reported in Table 1 of [52]. These results are presented in terms of the reduced order, the obtained group delays τ 1 and τ 2 and their ripple Δ τ , the maximum ripple Δ p in the passband region, and the maximum ripple in the stopband region Δ s . The proposed method gives a filter with comparable performance to that of the same order filter obtained in [6,52], with improvements in the maximum passband ripple Δ p , the stopband Δ s , and the group delay ripple Δ τ , as shown in Table 1 below. The table also shows that a smaller number of coefficients is required by the obtained 2-D IIR filter than the original 2-D FIR.
We also analyze the complexity of the implementation based on the number of non-zero coefficients in the transfer function of the filter. When implementing a general N 1 × N 2 2-D FIR filter, the number of filter coefficients C is ( N 1 + 1 ) ( N 2 + 1 ) , so the cost of implementation increases rapidly as N 1 or N 2 increases. In this example, for the 2-D FIR filter of order (24,24), C is 625, whereas for the reduced-order (13,13) 2-D IIR filter with a separable denominator, C is 14 × 14 for the numerator plus 2 × 14 for the denominator (i.e., C = 224 ). We can see that implementing the 2-D IIR filter designed by the proposed method requires less than half of the number of coefficients required by the 2-D FIR filter.

5.2. 2-D Bandpass Filter

In this example, we design a 2-D bandpass filter to satisfy the following specifications:
H ( ω 1 , ω 2 ) = 1 ω p 1 2 ω 1 2 + ω 2 2 ω p 2 2 0 o t h e r w i s e
where ω p 1 = 0.2 π and ω p 2 = 0.5 π . First, a linear-phase 2-D FIR filter of order (24,24) is designed using a window method to satisfy the design specifications. Then, a 2-D IIR bandpass filter of a reduced order (13,13) is obtained by using the proposed method. In this example, the computation time for controllability Gramian P s and observability Gramian Q s was 6.88 s. The number of coefficients for the FIR filter of order (24,24) is ( N 1 + 1 ) × ( N 2 + 1 ) = 625 , while the obtained IIR filter of a reduced order of (13,13) has a reduced number of coefficients equal to 224. The magnitude response of the full-order (24,24) 2-D FIR bandpass filter is shown in Figure 3a. The reduced-order (13,13) filter is stable, and its magnitude response is shown in Figure 3b. The group delays τ 1 and τ 2 over the passband are illustrated in Figure 3c,d.

5.3. Two-Dimensional Fan Filter

Fan filters constitute an important class of 2-D filters that find applications, for example, in geological and seismological data processing and beamforming [53,54]. This type of 2-D filter has the capability of directional filtering, where the signal is passed or rejected according to its direction. In this example, the proposed method is employed in the design of a 2-D fan filter having the magnitude response described in [55], with ω 1 and ω 2 as the two frequency variables where π ω 1 , ω 2 π .
H ( ω 1 , ω 2 ) = 1 | ω 2 | | ω 1 | 0 o t h e r w i s e
The first step is to construct a 2-D linear-phase FIR fan filter with order (49,49). Figure 4a shows the magnitude response of the initial 2-D FIR fan filter. Second, a reduced-order nearly linear-phase 2-D IIR fan filter of order (34,34) is obtained using the method proposed in Section 4. The magnitude response of the reduced-order 2-D IIR fan filter is illustrated in Figure 4b. The group delays τ 1 and τ 2 of the reduced-order 2-D IIR fan filter are shown in Figure 4c,d, respectively. Figure 4e shows the impulse response of the reduced-order 2-D IIR fan filter. The magnitude contour of the same reduced-order 2-D IIR fan filter is illustrated in Figure 4f. The number of multiplications and additions for the 2-D FIR initial filter of order (49,49) is ( N 1 + 1 ) × ( N 2 + 1 ) = 2500 and 2499, respectively. For implementation purposes, the obtained 2-D IIR fan filter with a reduced order of (34,34) has fewer computations: 1295 multiplications and 1294 additions. The computation time for controllability Gramian P s and observability Gramian Q s is 6.53 s. As can be seen, the designed 2-D IIR fan filter has a lower order compared with the 2-D FIR filter, which would lead to reducing the computational complexity in the implementation to achieve the same performance.

5.4. Fan Filtering of Plane Wave Image

We present a 2-D fan filter for ground roll attenuation in this section. A specific kind of Rayleigh wave with low frequency, low velocity, and high amplitude is called ground roll. It is the main type of coherent noise in land seismic surveys [56]. We generate an image via the sum of plane waves (PWs) with two angles, θ 1 = 80 and θ 2 = 100 , measured counterclockwise from the horizontal. The wave has ω 1 = 100 / 512 × 2 π rad/pixels and ω 2 = 53 / 512 × 2 π rad/pixels over the size N = 512 pixels of the output image. 2-D FIR and IIR fan filters are designed to be applied to this PW image, where it is required to design a reduced-order 2-D IIR fan filter to satisfy the following design specifications:
H ( ω 1 , ω 2 ) = 1 | ω 1 2 | 0.57 | ω 2 2 | 0 | ω 1 2 | > 0.57 | ω 2 2 |
Figure 5a shows the magnitude response of the initial 2-D FIR fan filter of order (24,24) designed using the window method. The reduced 2-D IIR fan filter of order (17,17) obtained by using the proposed method is shown in Figure 5b.
For comparison purposes, the 2-D FIR fan filter of order (24,24) shown in Figure 5a is applied to this PW image first, where Figure 6 shows the original and filtered images and their 2-D spectra. The reduced-order 2-D IIR fan filter of order (17,17) shown in Figure 5b is then applied to the same image, and the result is shown in Figure 7. In terms of the computation complexity, the 2-D FIR fan filter of order (24,24) has a number of coefficients C equal to 625, whereas for the reduced-order (17,17) 2-D IIR fan filter, we have 18 × 18 for the numerator plus 2 × 18 for the denominator (i.e., the number of coefficients is C = 360 ), which is reduced to less than 58%. For implementation, we can see that the obtained 2-D IIR fan filter requires less than half the number of coefficients required by the 2-D FIR fan filter. The results show that the reduced-order 2-D IIR fan filter designed using the proposed method has good filtering performance on the PW image as well as the advantage of a low implementation cost in terms of adders and multipliers over the 2-D FIR fan filter.

6. Conclusions

A method to design nearly linear-phase 2-D filters has been presented. The method is based on the model reduction of 2-D filters using balanced realization. The design method starts with the design of a 2-D linear-phase FIR filter and its state-space representation as a 2-D system with a separable denominator. The balanced realization of this system can be obtained using the 2-D structural controllability and structural observability Gramians of the system. These block-diagonal Gramians satisfy a set of Lyapunov inequalities, which are solved using an optimization approach under linear matrix inequality constraints. The use of the structural Gramians ensures that the resulting reduced-order system satisfies a 2-D Lyapunov equation and is, therefore, 2-D stable. The proposed method is illustrated by numerical examples that have shown that the method is suitable for the design of reduced-order 2-D IIR filters with nearly linear phase in the passband. The performance of the obtained 2-D IIR filters compares favorably with existing techniques, while at the same time they can be implemented using a separable-denominator filter with less computational complexity than the original 2-D FIR filter. Although the phase of the reduced-order 2-D IIR filter is only nearly linear, we can see that the reduced-order 2-D IIR filter offers good selectivity, computation efficiency, and reduced system delay when compared to the corresponding 2-D FIR filter.

Author Contributions

Conceptualization, A.O. and P.A.; methodology, A.O. and P.A.; software, A.O., P.A. and D.S.; validation, A.O., P.A. and D.S.; formal analysis, A.O., P.A. and D.S.; investigation, A.O., P.A. and D.S.; resources, A.O. and P.A.; data curation, A.O. and P.A.; writing—original draft preparation, A.O.; writing—review and editing, A.O., P.A. and D.S.; visualization, A.O., P.A. and D.S.; supervision, P.A. and D.S.; project administration, A.O., P.A. and D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by NSERC of Canada.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
1-DOne-Dimensional
2-DTwo-Dimensional
FIRFinite Impulse Response
IIRInfinite Impulse Response
LMILinear Matrix Inequality
MORModel Order Reduction
PBPassband
SBStopband
SDPSemi-Definite Problem
trTrace
diagDiagonal
MinMinimum
MaxMaximum
PWPlane Wave
UUnit Circle

Appendix A

Appendix A.1

In this Appendix, two examples of obtaining the structured controllability and structured observability Gramians are presented. They include 2-D system matrices in the non-separable and separable characteristic polynomial.
Example A1. 
Consider a 2-D discrete system described by Roesser’s model, ( m , n ) = ( 2 , 2 ) , as follows:
A = 0.5000 0.7500 0.3895 0.0389 0 0 0 0 0.1423 0 0.4000 0.0200 0.0342 0 0.6000 0.0300
where x h R 2 and x v R 2 .
b = 1 0 1 0 T
c = 1 0 0 0
Applying the proposed LMI algorithm to solve the Lyapunov inequalities, the structured controllability and the structured observability Gramians are found to be positive-definite block-diagonal matrices as given below:
P s = 2.6744536 0.0000005 0 0 0.0000005 0.0000018 0 0 0 0 1.7237207 0.1361198 0 0 0.1361198 0.7926782
Q s = 1.6523883 0.8820146 0 0 0.8820146 1.2662409 0 0 0 0 1.2060296 0.0671541 0 0 0.0671541 0.0173983
Example A2. 
In this example, we consider the following 2-D model Σ = ( A 11 , A 12 , A 21 , A 22 , b 1 , b 2 , c 1 , c 2 ) , also presented as an illustrative example in Section 3.4 in [22]. The corresponding system matrices are given below:
A 11 = 0 1 0 0 0 0 1 0 0 0 0 1 0.282145 0.551205 0.875599 1.361780 ,
A 12 = 0 4 × 4 ,
A 21 = 0.020056 0.114892 0.167819 0.227100 0.011559 0.054709 0.120890 0.150348 0.026037 0.035530 0.034800 0.047409 0.032347 0.055488 0.045669 0.077340 ,
A 22 = 0 0 0 0.090322 1 0 0 0.199219 0 1 0 0.390625 0 0 1 0.750000 ,
b 1 = 0 0 0 1 T ,
b 2 = 0.368103 0.315109 0.227313 0.073000 T ,
c 1 = 0.261041 0.127614 0.033891 0.424881 ,
c 2 = 0 0 0 1 ,
d = 0.6520 .
Here, x h R 4 and x v R 4 . Note that since A 12 is a zero matrix, this is a separable-denominator system where the denominator of the corresponding transfer function can be factored as the product of a polynomial in z 1 by a polynomial in z 2 . The structured controllability matrix P s and the structured observability matrix Q s are found to be symmetric positive-definite and block-diagonal matrices where P s = d i a g ( p 1 , p 2 ) and Q s = d i a g ( q 1 , q 2 ) and these sub-matrices p i and q i for i = 1 , 2 are given as below:
p 1 = 8.1089 6.7562 4.6871 3.0064 6.7562 7.5461 6.2880 4.3242 4.6871 6.2880 7.0435 5.8058 3.0064 4.3242 5.8058 6.4723 ,
p 2 = 2.5173 1.8049 1.0641 0.5113 1.8049 4.2626 2.7316 1.7339 1.0641 2.7316 4.2820 1.9780 0.5113 1.7339 1.9780 5.2563 ,
q 1 = 0.6672 0.7158 0.7194 0.7046 0.7158 1.5485 1.5435 1.7515 0.7194 1.5435 2.3619 2.7027 0.7046 1.7515 2.7027 4.8899 ,
q 2 = 3.0759 1.8324 0.6877 0.3077 1.8324 2.7993 1.6562 0.5947 0.6877 1.6562 2.5770 1.5290 0.3077 0.5947 1.5290 2.3714 ,
For the same system presented in the above example, we consider now a non-separable denominator case where the matrix A 12 is given by:
A 12 = 0.0050 0.0287 0.0420 0.0568 0.0029 0.0137 0.0302 0.0376 0.0065 0.0089 0.0087 0.0119 0.0081 0.0139 0.0114 0.0193
The results obtained for the block-diagonal structured controllability and observability Gramians P s = d i a g ( p 1 , p 2 ) and Q s = d i a g ( q 1 , q 2 ) are found to be as follows:
p 1 = 8.7104 7.0353 5.0428 3.2759 7.0353 7.9591 6.6426 4.5683 5.0428 6.6426 7.3986 6.0962 3.2759 4.5683 6.0962 6.7877 ,
p 2 = 2.4947 1.6721 0.7320 0.7283 1.6721 4.0632 2.3814 1.3424 0.7320 2.3814 4.4503 1.9242 0.7283 1.3424 1.9242 5.5830 ,
q 1 = 0.7372 0.7142 0.7476 0.7911 0.7142 1.5399 1.5141 1.7804 0.7476 1.5141 2.4323 2.7913 0.7911 1.7804 2.7913 5.0316 ,
q 2 = 3.4080 1.8370 0.6826 0.3415 1.8370 3.1150 1.6702 0.5627 0.6826 1.6702 2.8215 1.6037 0.3415 0.5627 1.6037 2.4459 ,

References

  1. Lim, J.S. Two-Dimensional Signal and Image Processing; Prentice Hall: Englewood Cliffs, NJ, USA, 1990; 710p. [Google Scholar]
  2. Dudgeon, D.E.; Mersereau, R.M. Multidimensional Digital Signal Processing; Prentice-Hall Signal Processing Series; Prentice Hall: Englewood Cliffs, NJ, USA, 1984. [Google Scholar]
  3. Lu, W.S.; Antoniou, A. Two-Dimensional Digital Filters; CRC Press: Boca Raton, FL, USA, 1992; Volume 80. [Google Scholar]
  4. Wijesekara, R.T.; Edussooriya, C.U.; Bruton, L.T.; Agathoklis, P. A low-complexity 2-D spatially-interpolated FIR trapezoidal filter for enhancing broadband plane waves. In Proceedings of the 2017 10th International Workshop on Multidimensional (nD) Systems (nDS), Zielona Góra, Poland, 13–15 September 2017; pp. 1–6. [Google Scholar]
  5. Hua, J.; Kuang, W.; Gao, Z.; Meng, L.; Xu, Z. Image denoising using 2-D FIR filters designed with DEPSO. Multimed. Tools Appl. 2014, 69, 157–169. [Google Scholar] [CrossRef]
  6. Xiao, C.; Agathoklis, P. Design and implementation of approximately linear phase two-dimensional IIR filters. IEEE Trans. Circuits Syst. II Analog Digit. Signal Process. 1998, 45, 1279–1288. [Google Scholar] [CrossRef]
  7. Zhou, K.; Aravena, J.; Gu, G.; Xiong, D. 2-D model reduction by quasi-balanced truncation and singular perturbation. IEEE Trans. Circuits Syst. II Analog Digit. Signal Process. 1994, 41, 593–602. [Google Scholar] [CrossRef]
  8. Gu, G.; Shenoi, B. A novel approach to the synthesis of recursive digital filters with linear phase. IEEE Trans. Circuits Syst. 1991, 38, 602–612. [Google Scholar] [CrossRef]
  9. Gorinevsky, D.; Boyd, S. Optimization-based design and implementation of multidimensional zero-phase IIR filters. IEEE Trans. Circuits Syst. I Regul. Pap. 2006, 53, 372–383. [Google Scholar] [CrossRef]
  10. Lai, X.; Meng, H.; Cao, J.; Lin, Z. A sequential partial optimization algorithm for minimax design of separable-denominator 2-D IIR filters. IEEE Trans. Signal Process. 2017, 65, 876–887. [Google Scholar] [CrossRef]
  11. Ramamoorthy, P.; Bruton, L. Design of stable two-dimensional analogue and digital filters with applications in image processing. Int. J. Circuit Theory Appl. 1979, 7, 229–245. [Google Scholar] [CrossRef]
  12. Hinamoto, T.; Maekawa, S. Design of two-dimensional recursive digital filters using mirror-image polynomials. IEEE Trans. Circuits Syst. 1986, 33, 750–758. [Google Scholar] [CrossRef]
  13. Aly, S.; Fahmy, M. Design of two-dimensional recursive digital filters with specified magnitude and group delay characteristics. IEEE Trans. Circuits Syst. 1978, 25, 908–916. [Google Scholar] [CrossRef]
  14. Chottera, A.; Jullien, G. A linear programming approach to recursive digital filter design with linear phase. IEEE Trans. Circuits Syst. 1982, 29, 139–149. [Google Scholar] [CrossRef]
  15. Dumitrescu, B. Optimization of two-dimensional IIR filters with nonseparable and separable denominator. IEEE Trans. Signal Process. 2005, 53, 1768–1777. [Google Scholar] [CrossRef]
  16. Miyata, T.; Aikawa, N.; Sugita, Y.; Yoshikawa, T. A design method for separable-denominator 2D IIR filters using a stability criterion based on the system matrix. In Proceedings of the 15th IEEE International Conference on Electronics, Circuits and Systems, St. Julien’s, Malta, 31 August–3 September 2008; pp. 826–829. [Google Scholar]
  17. Mastorakis, N.E.; Gonos, I.F.; Swamy, M. Design of two-dimensional recursive filters using genetic algorithms. IEEE Trans. Circuits Syst. I Fundam. Theory Appl. 2003, 50, 634–639. [Google Scholar] [CrossRef]
  18. Wysocka-Schillak, F. Design of separable 2-D IIR Filters with approximately linear phase in the passband using genetic algorithm. In Proceedings of the 2008 Conference on Human System Interactions, Krakow, Poland, 25–27 May 2008; pp. 66–70. [Google Scholar]
  19. Holford, S.; Agathoklis, P. The use of model reduction techniques for designing IIR filters with linear phase in the passband. IEEE Trans. Signal Process. 1996, 44, 2396–2404. [Google Scholar] [CrossRef]
  20. Lawson, S.; Anderson, M. The design of 2-D approximately linear phase filters using a direct approach. Signal Process. 1997, 57, 205–221. [Google Scholar] [CrossRef]
  21. Mitiche, L.; Adamou-Mitiche, A.B.H. New procedure in designing 2D-IIR filters based on 2D-FIR filters approximation. IEEE Trans. Syst. Signal Process. Regul. Pap. 2013, 57, 515–520. [Google Scholar]
  22. Guo, T.Y.; Hwang, C.; Shieh, L.S.; Chen, C.H. Reduced-order models of 2-D linear discrete separable-denominator system using bilinear Routh approximations. IEE Proc. G Circuits Devices Syst. 1992, 139, 45–56. [Google Scholar] [CrossRef]
  23. Mitiche, L.; Adamou-Mitiche, A.B.H. New procedure in designing 2D-IIR filters based on 2D-FIR filters approximation. In Proceedings of the 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA), Algiers, Algeria, 12–15 May 2013; pp. 515–520. [Google Scholar]
  24. Sun, J.; Fang, W.; Xu, W. A quantum-behaved particle swarm optimization with diversity-guided mutation for the design of two-dimensional IIR digital filters. IEEE Trans. Circuits Syst. II Express Briefs 2010, 57, 141–145. [Google Scholar] [CrossRef]
  25. Anderson, B.; Agathoklis, P.; Jury, E.; Mansour, M. Stability and the matrix Lyapunov equation for discrete 2-dimensional systems. IEEE Trans. Circuits Syst. 1986, 33, 261–267. [Google Scholar] [CrossRef]
  26. Lashgari, B.; Silverman, L.; Abramatic, J.F. Approximation of 2-D separable in denominator filters. IEEE Trans. Circuits Syst. 1983, 30, 107–121. [Google Scholar] [CrossRef]
  27. Kumar, A.; Fairman, F.; Sveinsson, J. Separately balanced realization and model reduction of 2-D separable-denominator transfer functions from input-output data. IEEE Trans. Circuits Syst. 1987, 34, 233–239. [Google Scholar] [CrossRef]
  28. Beliczynski, B.; Kale, I.; Cain, G.D. Approximation of FIR by IIR digital filters: An algorithm based on balanced model reduction. IEEE Trans. Signal Process. 1992, 40, 532–542. [Google Scholar] [CrossRef]
  29. Lu, W.S.; Wang, H.P.; Antoniou, A. Design of two-dimensional digital filters using singular-value decomposition and balanced approximation method. In Proceedings of the IEEE International Symposium on Circuits and Systems, Portland, OR, USA, 8–11 May 1989; pp. 1656–1659. [Google Scholar]
  30. Lu, W.S.; Luo, H.; Antoniou, A. Recent results on model reduction methods for 2-D discrete systems. In Proceedings of the IEEE International Symposium on Circuits and Systems, Atlanta, GA, USA, 15 May 1996; Circuits and Systems Connecting the World. Volume 2, pp. 348–351. [Google Scholar]
  31. Willems, J. Least squares stationary optimal control and the algebraic Riccati equation. IEEE Trans. Autom. Control 1971, 16, 621–634. [Google Scholar] [CrossRef]
  32. Boyd, S.; El Ghaoui, L.; Feron, E.; Balakrishnan, V. Linear Matrix Inequalities in System and Control Theory; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 1994; Volume 15. [Google Scholar]
  33. Knorn, S.; Middleton, R.H. Stability of two-dimensional linear systems with singularities on the stability boundary using LMIs. IEEE Trans. Autom. Control 2013, 58, 2579–2590. [Google Scholar] [CrossRef]
  34. Xue, D.; Chen, Y. Solving Applied Mathematical Problems with MATLAB; Chapman and Hall/CRC: Boca Raton, FL, USA, 2008. [Google Scholar]
  35. Li, L.; Paganini, F. Structured coprime factor model reduction based on LMIs. Automatica 2005, 41, 145–151. [Google Scholar]
  36. Vandendorpe, A.; Van Dooren, P. Model reduction of interconnected systems. In Proceedings of the International Symposium on Mathematical Theory in Networks and Systems, Leuven, Belgium, 5–9 July 2004. [Google Scholar]
  37. Beck, C.L.; Doyle, J.; Glover, K. Model reduction of multidimensional and uncertain systems. IEEE Trans. Autom. Control 1996, 41, 1466–1477. [Google Scholar] [CrossRef]
  38. Premaratne, K.; Jury, E.; Mansour, M. An algorithm for model reduction of 2-D discrete time systems. IEEE Trans. Circuits Syst. 1990, 37, 1116–1132. [Google Scholar] [CrossRef]
  39. Okuda, M.; Matsuda, K.; Ikehara, M.; Takahashi, S.i. Complex approximation of 2-D digital filters with prescribed log magnitude phase response. In Proceedings of the Digital Processing Applications (TENCON’96), Perth, WA, Australia, 26–29 November 1996; Volume 1, pp. 388–393. [Google Scholar]
  40. Nikolic, S.; Stojanovic, V. Design of 2D IIR digital filters with approximately flat group delay characteristic. In Proceedings of the 5th International Conference on Telecommunications in Modern Satellite, Cable and Broadcasting Service, Nis, Yugoslavia, 19–21 September 2001; Volume 2, pp. 807–810. [Google Scholar]
  41. Roesser, R. A discrete state-space model for linear image processing. IEEE Trans. Autom. Control 1975, 20, 1–10. [Google Scholar] [CrossRef]
  42. Fazel, M.; Hindi, H.; Boyd, S.P. A Rank Minimization Heuristic with Application to Minimum Order System Approximation. In Proceedings of the American Control Conference, Arlington, VA, USA, 25–27 June 2001; pp. 4734–4739. [Google Scholar]
  43. Helton, J.W.; McCullough, S.; Putinar, M.; Vinnikov, V. Convex matrix inequalities versus linear matrix inequalities. IEEE Trans. Autom. Control 2009, 54, 952–964. [Google Scholar] [CrossRef]
  44. Tran, T. Linear matrix inequalities for dissipative constraints in stabilization with relaxed non-monotonic Lyapunov function. In Proceedings of the International Conference on Control, Automation and Information Sciences (ICCAIS), Chiang Mai, Thailand, 31 October–1 November 2017; pp. 61–66. [Google Scholar]
  45. Skelton, R.E.; Iwasaki, T.; Grigoriadis, D.E. A Unified Algebraic Approach to Control Design; CRC Press: Boca Raton, FL, USA, October 1997. [Google Scholar]
  46. Mesbahi, M. On the rank minimization problem and its control applications. Syst. Control Lett. 1998, 33, 31–36. [Google Scholar] [CrossRef]
  47. Mesbahi, M.; Papavassilopoulos, G.P. On the rank minimization problem over a positive semidefinite linear matrix inequality. IEEE Trans. Autom. Control 1997, 42, 239–243. [Google Scholar] [CrossRef]
  48. Hmamed, A.; Alfidi, M.; Benzaouia, A.; Tadeo, F. LMI conditions for robust stability of 2D linear discrete-time systems. Math. Probl. Eng. 2008, 2008, 356124. [Google Scholar] [CrossRef]
  49. Ghafoor, A.; Sreeram, V. A survey/review of frequency-weighted balanced model reduction techniques. J. Dyn. Syst. Meas. Control 2008, 130, 061004. [Google Scholar] [CrossRef]
  50. Moore, B. Principal component analysis in linear systems: Controllability, observability, and model reduction. IEEE Trans. Autom. Control 1981, 26, 17–32. [Google Scholar] [CrossRef]
  51. Kockanat, S.; Karaboga, N. The design approaches of two-dimensional digital filters based on metaheuristic optimization algorithms: A review of the literature. Artif. Intell. Rev. 2015, 44, 265–287. [Google Scholar] [CrossRef]
  52. Gu, G.; Shenoi, B.A.; Zhang, C. Synthesis of 2-D linear phase digital filters. IEEE Trans. Circuits Syst. 1990, 37, 1499–1508. [Google Scholar] [CrossRef]
  53. Bruton, L.; Bartley, N. A general-purpose computer program for the design of two-dimensional recursive filters—2DFil. Circuits Syst. Signal Process. 1984, 3, 243–264. [Google Scholar] [CrossRef]
  54. Bruton, L.; Bartley, N. Using nonessential singularities of the second kind in two-dimensional filter design. IEEE Trans. Circuits Syst. 1989, 36, 113–116. [Google Scholar] [CrossRef]
  55. Matei, R. Design approach for a class of 2D recursive filters. In Proceedings of the 2017 International Symposium on Signals, Circuits and Systems (ISSCS), Tokyo, Japan, 13–14 July 2017; pp. 1–4. [Google Scholar]
  56. Porsani, M.J.; Silva, M.G.; Melo, P.E.; Ursin, B. Ground-roll attenuation based on SVD filtering. In Proceedings of the 2009 SEG Annual Meeting, Houston, TX, USA, 25–30 October 2009; OnePetro: Richardson, TX, USA, 2009. [Google Scholar]
Figure 1. Flowchart of the proposed method.
Figure 1. Flowchart of the proposed method.
Signals 04 00044 g001
Figure 2. Magnitude responses and group delays of 2-D lowpass FIR and IIR filters discussed in Example 1 of Section 5.1: (a) 2-D FIR lowpass filter of order (24,24); (b) 2-D IIR of reduced order (13,13) in [6]; (c) 2-D IIR of reduced order (13,13) using LMI; (d) magnitude contour of reduced-order filter; (e) group delay τ 1 of reduced order (13,13); (f) group delay τ 2 of reduced order (13,13).
Figure 2. Magnitude responses and group delays of 2-D lowpass FIR and IIR filters discussed in Example 1 of Section 5.1: (a) 2-D FIR lowpass filter of order (24,24); (b) 2-D IIR of reduced order (13,13) in [6]; (c) 2-D IIR of reduced order (13,13) using LMI; (d) magnitude contour of reduced-order filter; (e) group delay τ 1 of reduced order (13,13); (f) group delay τ 2 of reduced order (13,13).
Signals 04 00044 g002
Figure 3. Magnitude responses and group delays of the reduced 2-D IIR bandpass filter described in Section 5.2.
Figure 3. Magnitude responses and group delays of the reduced 2-D IIR bandpass filter described in Section 5.2.
Signals 04 00044 g003
Figure 4. 2-D FIR and IIR fan filters described in Section 5.3: (a) initial 2-D FIR fan filter of order (49,49); (b) reduced 2-D IIR fan filter of order (34,34); (c) group delay τ 1 of reduced 2-D IIR fan filter; (d) group delay τ 2 of reduced 2-D IIR fan filter; (e) impulse response of 2-D IIR fan filter; (f) magnitude contour of the reduced fan filter.
Figure 4. 2-D FIR and IIR fan filters described in Section 5.3: (a) initial 2-D FIR fan filter of order (49,49); (b) reduced 2-D IIR fan filter of order (34,34); (c) group delay τ 1 of reduced 2-D IIR fan filter; (d) group delay τ 2 of reduced 2-D IIR fan filter; (e) impulse response of 2-D IIR fan filter; (f) magnitude contour of the reduced fan filter.
Signals 04 00044 g004
Figure 5. Magnitude response of 2-D FIR and IIR fan filters described in Section 5.4.
Figure 5. Magnitude response of 2-D FIR and IIR fan filters described in Section 5.4.
Signals 04 00044 g005
Figure 6. Original and filtered plane wave images using 2-D FIR fan filter and their spectrum.
Figure 6. Original and filtered plane wave images using 2-D FIR fan filter and their spectrum.
Signals 04 00044 g006
Figure 7. Original and filtered plane wave images using reduced-order 2-D IIR fan filter and their spectrum.
Figure 7. Original and filtered plane wave images using reduced-order 2-D IIR fan filter and their spectrum.
Signals 04 00044 g007
Table 1. Comparison results of the 2-D IIR filters.
Table 1. Comparison results of the 2-D IIR filters.
Proposed
Method
Method in
[6]
Method in
[52]
Orders(13,13)(13,13)(18,18)
Group Delay(12,12)(12,12)(12,12)
Δ p 0.01020.01240.0128
Δ s 0.00600.01110.0350
Δ τ 0.04250.0725-
C F I R 625625676
C I I R 224224399
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Omar, A.; Shpak, D.; Agathoklis, P. Nearly Linear-Phase 2-D Recursive Digital Filters Design Using Balanced Realization Model Reduction. Signals 2023, 4, 800-815. https://0-doi-org.brum.beds.ac.uk/10.3390/signals4040044

AMA Style

Omar A, Shpak D, Agathoklis P. Nearly Linear-Phase 2-D Recursive Digital Filters Design Using Balanced Realization Model Reduction. Signals. 2023; 4(4):800-815. https://0-doi-org.brum.beds.ac.uk/10.3390/signals4040044

Chicago/Turabian Style

Omar, Abdussalam, Dale Shpak, and Panajotis Agathoklis. 2023. "Nearly Linear-Phase 2-D Recursive Digital Filters Design Using Balanced Realization Model Reduction" Signals 4, no. 4: 800-815. https://0-doi-org.brum.beds.ac.uk/10.3390/signals4040044

Article Metrics

Back to TopTop