Next Article in Journal
Image Segmentation Based on Dynamic Particle Swarm Optimization for Crystal Growth
Previous Article in Journal
Deep CNNs with Robust LBP Guiding Pooling for Face Recognition
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Inshore Ship Detection Based on Level Set Method and Visual Saliency for SAR Images

1
State Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha 410073, China
2
College of Information and Communication, National University of Defense Technology, Xi’an 710106, China
*
Author to whom correspondence should be addressed.
Submission received: 24 October 2018 / Revised: 8 November 2018 / Accepted: 9 November 2018 / Published: 11 November 2018
(This article belongs to the Section Remote Sensors)

Abstract

:
Inshore ship detection is an important research direction of synthetic aperture radar (SAR) images. Due to the effects of speckle noise, land clutters and low signal-to-noise ratio, it is still challenging to achieve effective detection of inshore ships. To solve these issues, an inshore ship detection method based on the level set method and visual saliency is proposed in this paper. First, the image is fast initialized through down-sampling. Second, saliency map is calculated by improved local contrast measure (ILCM). Third, an improved level set method based on saliency map is proposed. The saliency map has a higher signal-to-noise ratio and the local level set method can effectively segment images with intensity inhomogeneity. In this way, the improved level set method has a better segmentation result. Then, candidate targets are obtained after the adaptive threshold. Finally, discrimination is employed to get the final result of ship targets. The experiments on a number of SAR images demonstrate that the proposed method can detect ship targets with reasonable accuracy and integrity.

1. Introduction

Ship detection for synthetic aperture radar (SAR) images is of great importance in both military and commercial applications [1,2,3]. The technology of ship detection for SAR images has made great progress [4,5,6], while fewer works are available for inshore ship detection. Due to the high similarity between the land and the ship body on gray level and texture features, the traditional methods are unable to achieve effective detection results [7].
In recent years, the level set method (LSM) has been widely applied in the fields of image processing [8] and computer vision. This method uses the geometric metrics of the curve such as the curvature and the normal vector to control the movement of the curve, so it does not depend on the parameters of the curve and can handle the changes of the topology. The level set method was first devised by Osher and Sethian [9] in 1988. Peng et al. [10] developed a Partial Differential Equation (PDE) based fast local level set method, and addressed two important issues that are intrinsic to the level set method. Adalsteinsson and Sethian [11] applied the Fast Marching Method, which is a very fast technique for solving the Eikonal and related equations, to the problem of building fast and appropriate extension velocities for the neighboring level sets. Chart and Vese [12] proposed a simplified Mumford-Sha model called the CV model in 2001. This model adds regularization terms in the energy function and is robust for images with Gaussian noise, but for images with intensity inhomogeneity, it often cannot perform a satisfactory segmentation result. Li et al. [13,14] proposed an effective Local Binary Fitting (LBF) model by introducing a Gaussian kernel function into the energy function. The model can effectively segment images with intensity inhomogeneity and avoids expensive reinitialization, but it is sensitive to initialization curve. Then Li et al. [15] proposed a distance regularized level set evolution (DRLSE) which eliminates the need for reinitialization and slightly avoids its induced numerical errors. Lv [16] integrated the fuzzy decision and a special local energy function to deal with vessel images. Wang [17] proposed an edge entropy fitting (EEF) energy, which is based on the LBF model, has achieved a reasonable segmentation result.
In the human visual system (HVS), it is the contrast not the brightness that occupies the most important part [18,19,20]. Itti [21] first proposed a saliency detection algorithm based on center-surround in 1998. The algorithm expresses three features (brightness, color, and direction) as a multi-scale Gaussian pyramid, and finally obtains a saliency map. In 2014, Chen et al. [22] proposed a local contrast measure (LCM) by measuring the difference between the current location and the local neighborhood, and then obtain a saliency map, which can achieve premier results. However, this algorithm will strengthen the false alarm point in the calculation process and increase the false alarm rate. Han et al. [23] proposed an improved LCM (ILCM) algorithm. The algorithm processed the image into sub-blocks and replaced the maximum value in the LCM algorithm with the mean value. Therefore, the false alarm rate is decreased. In recent years, visual saliency map has been applied to ship detection in SAR images [24]. In order to detect ship targets in SAR images, an optimal window selection mechanism based on the multiscale local contrast measure (LCM) is used in the local variance weighted information entropy (VWIE) [25].
The LBF is a well-known local information model which gets desirable segmentation results of images with intensity inhomogeneity. LCM and ILCM are two methods widely applied in computer vision. By calculating the saliency map, those two methods can improve the signal-to-noise ratio and get good performance on target detection.
Therefore, derived from LBF model and ILCM, an inshore ship detection method based on the level set method and visual saliency is proposed in this paper. Firstly, for the drawback that LBF model is sensitive to initialization curve, the image is quickly initialized by down-sampling. Then an improved level set method (improved LSM) based on the saliency map is proposed. The saliency map can improve the signal-to-noise ratio and solve the problem that LBF has poor segmentation results for SAR images. Finally, the adaptive threshold and discrimination are employed to obtain the final ship targets.
This paper is organized as follows. Related work and their detailed advantages or drawbacks are presented in Section 2. In Section 3, fast initialization, improved LSM, adaptive threshold and discrimination are described. Experimental results and analysis are given in Section 4. The conclusion is in Section 5.

2. Related Work

2.1. LBF Model

This paper mainly focuses on inshore ship detection, so we only consider a two-phase level set formulation. That is, the image is segmented into two disjoint regions, one is ship the targets region and the rest is the background region.
The LBF model [14] was proposed to deal with intensity inhomogeneity in the segmentation. The key steps are as follows.
The energy function ε L B F ( ϕ , f 1 ( y ) , f 2 ( y ) ) is defined as:
ε L B F ( ϕ , f 1 ( y ) , f 2 ( y ) ) = i = 1 2 λ i K σ ( y x ) | I ( x ) f i ( y ) | 2 M i ( ϕ ( x ) ) d x
where ϕ is the level set function, f 1 ( y ) and f 2 ( y ) are two values that approximate image intensities inside and outside ϕ = 0 . H is the Heaviside function, and M 1 ( ϕ ) = H ( ϕ ) , M 2 ( ϕ ) = 1 H ( ϕ ) . λ 1 and λ 2 are weighting parameters. K is the Gaussian function with a standard deviation of σ , defined by:
K σ ( y x ) = exp ( ( y x ) 2 / 2 σ 2 ) / 2 π σ
after the iterations of energy function ε L B F ( ϕ , f 1 ( y ) , f 2 ( y ) ) , image segmentation result is obtained by level set function ϕ .
LBF model can effectively segment inhomogeneous images. However, it has two drawbacks:
  • It is sensitive to initial contour.
    Figure 1a,d are the original images with different initialization curves (red square). Figure 1b,c are the results after 300 iterations and 3000 iterations. No matter after how many iterations, level set function with initialization curve 1 cannot converge around the targets. Figure 1e is the result of Figure 1d after 300 iterations. It shows that the level set function with initialization curve 2 can well converge around the targets. By comparison, different initialization curves lead to different results. Therefore, it can be concluded that the LBF model is sensitive to initialization curve.
  • It has poor performances for SAR images segmentation.
    This is because the SAR images contain speckle noise, land architectures and have a low signal-to-noise ratio. Even for segmentation results with a proper initialization (as shown in Figure 1e), it still contains lots of clutters (including speckle noise and land architectures).

2.2. ILCM Method

In order to improve the signal-to-noise ratio of the targets, improved local contrast measure (ILCM) [23] is proposed based on the contrast mechanism. The key steps are as follows.
Let Ω be the image domain, for each point x Ω , its neighborhood called block ϖ . Divide ϖ into nine sub-blocks equally, marked as sub0, sub1, …, sub8. The locations of sub-blocks are shown in Figure 2.
The mean gray value of each sub-block sub(i) in the block ϖ is m i ( i = 0 , 1 , 8 ) , the maximum gray value in the middle sub-block sub0 is L n , thus:
m i = 1 N j = 1 N I j i    I j i sub ( i )
L n = max ( I j 0 )    I j 0 sub 0
The salient value of x Ω is defined as:
I L C M = min i L n m 0 m i i = 1 , 2 8
for each x Ω , calculates its salient value according to (5), and then a saliency map is obtained.
The advantage of ILCM is that the targets in the saliency map have higher signal-to-noise ratio than in the original image.
The reason is as follows. For example, if sub0 is the target region, usually max i m i < L n , thus I L C M = min i L n m 0 m i = m 0 L n max i ( m i ) > m 0 , then the target can be enhanced. In contrast, if sub0 is the patch around the target, usually L n < max i m i , thus I L C M = m 0 L n max i ( m i ) < m 0 , then the pixel around the target can be suppressed.
Therefore, the salient value of the target pixel is larger than its original grayscale, and the salient value of the pixel around the target is smaller than its original grayscale, thus the signal-to-noise ratio of target in the saliency map is enhanced. That is to say, the targets become more salient.

3. Proposed Method

Considering the advantages and drawbacks of LBF model and ILCM method above, an inshore ship detection based on the level set method and visual saliency is proposed.
Firstly, because the LBF model is sensitive to the initialization curve, the image is quickly initialized by down-sampling. Secondly, improved LSM is proposed to get level set function. The improved LSM, to be specific, is a level set method improved by visual saliency. Thirdly, candidate targets are gained by adaptive threshold of level set function. Finally, discrimination is employed to select final ship targets. The specific flowchart is shown in Figure 3.

3.1. Fast Initialization

This paper focuses on inshore ship detection. Inshore ships are usually large targets with certain sizes. Inspired by the objectless Binarized Normed Gradients (BING) algorithm [26], a fast initialization procedure is applied to our proposed method. The flowchart of the fast initialization is shown in Figure 4.
First, down-sampling the original image, that is, rescale the image into a smaller size. However, the rescale size must be smaller than the minimum size of the ship targets. Only in this way, even in the down-sampled image, there still have target pixels.
Then, binarize the down-sample image. The gradient of the down-sample image changes little, so it is easier to do the segmentation in the down-sample image. The threshold of binarization is obtained through the traditional Otsu [27] algorithm. After binarization, the image is segmented into the target part and background part.
Finally, up sample the binary image and the final initialization curve is obtained. Of course, this curve is relatively coarse, but it is enough to be used as an initialization curve.

3.2. Improved LSM

Improved LSM is short for the improved level set method, which specifically refers to a level set method based on visual saliency fitting energy.
First, the saliency map is calculated by the improved local contrast measure (ILCM).
For each point x Ω in the image, the calculation equation of the saliency map is rewritten as follows:
S ( x ) = I L C M = min i L n m 0 m i
Second, the calculation of improved LSM is mainly based on the saliency map, because the targets are more salient and the signal-to-noise ratio is higher in the saliency map.
Let Ω 1 and Ω 2 be the target region and background region respectively, and they satisfy Ω 1 Ω 2 = Ω and Ω 1 Ω 2 = , then we consider a neighborhood with a radius at each point y Ω , defined as O y { x : | x y | ρ } .
According to the LBF model, we define a visual saliency fitting energy ε ( ϕ , s 1 , s 2 ) as:
ε ( ϕ , s 1 , s 2 ) = i = 1 2 K σ ( x , y ) | S ( x ) s i ( y ) | 2 H i ( ϕ ( x ) ) d x d y
where ϕ is the level set function, S ( x ) is the salient value in the neighborhood of the position y. s 1 ( y ) and s 2 ( y ) are the mean value of the saliency intensity of O y Ω 1 and O y Ω 2 respectively.
ε ( ϕ , s 1 , s 2 ) denotes the data term. In order to regularize the level set function ϕ , two widely used regularization terms L ( ϕ ) = | H ( ϕ ) | d x and R p ( ϕ ) = p ( | ϕ | ) d x are adopted in our energy function. L ( ϕ ) computes the arc length of the level contour of ϕ = 0 , R p ( ϕ ) is the distance regularized level set formulation [28], the function p is defined as p ( s ) = ( 1 / 2 ) ( s 1 ) 2 .
Thus, the final energy function is given by:
F ( ϕ , s 1 , s 2 ) = ε ( ϕ , s 1 , s 2 ) + ν L ( ϕ ) + μ R p ( ϕ )
where ν and μ are the weighting parameters.
The final energy F ( ϕ , s 1 , s 2 ) is minimized by using the standard gradient descent method. With minimized F ( ϕ , s 1 , s 2 ) , we can obtain the result of image segmentation given by the level set function ϕ .
Keeping s 1 ( y ) and s 2 ( y ) fixed, the evolution formula of the level set function is:
ϕ t = δ ( t ) ( e 1 e 2 ) + υ δ ( ϕ ) d i v ( ϕ | ϕ | ) + μ d i v ( d p ( | ϕ | ) ϕ )
where is the gradient operator, div(.) is the divergence operator, and the d p and e i in (9) are defined as:
d p ( s ) p ( s ) s
e i ( y ) = K σ ( x , y ) | S ( x ) s i ( y ) | 2 d y
Meanwhile, for a fixed level set function ϕ , we minimize the function F ( ϕ , s 1 , s 2 ) with respect to the functions s 1 ( y ) and s 2 ( y ) which satisfy the following Euler–Lagrange equations:
K σ ( x , y ) ( S ( x ) s i ( y ) ) H i ( ϕ ( x ) ) d x = 0 i = 1 , 2
Then we obtain:
s i ( y ) = K σ ( x , y ) S ( x ) H i ( ϕ ( x ) ) d x K σ ( x , y ) H i ( ϕ ( x ) ) d x
Through all those equations, with minimized final energy function F ( ϕ , s 1 , s 2 ) , we can obtain the result of image segmentation given by the level set function ϕ .

3.3. Adaptive Threshold

The level set method is usually applied to magnetic resonance (MR) image segmentation. MR images are segmented into two parts by the curve of the level set function ( ϕ = 0 ). However, for SAR images, segmentation is more complex because of speckle noise as well as land architectures. Therefore, in order to detect targets better from the background, an adaptive threshold is proposed.
Inspired by Constant False-Alarm Rate (CFAR) detection algorithm [29], we define the adaptive threshold T as:
T 1 + h i ( s ) n < p T + h i ( s ) n
where h i ( s ) is the frequency of gray value s, n is the total number of pixels of level set function ϕ . p is approximately the proportion of targets in the entire image, and it is an empirical value. The value of p is different for different type of images. And for ship detection result, it is more important not to lose targets than to have some clutters, so p could set to be a little larger.

3.4. Discrimination

After the procedure of adaptive threshold, ship targets can be well detected. However, it is still possible that some clutter with similar intensity to targets cannot be removed, so further discrimination is needed.
Because the detection result of proposed method has good connectivity and integrity (detailed explanation is in Section 4.3), and most of the strong clutters remained in detection result is spot-like or small-area blocks, the targets can be detected with a simple discrimination based on area size. Specific steps are as follows:
  • Traverse the entire result image, search all the closed regions and number them R i , where 0 ≤ i N , N denotes the number of closed regions.
  • Calculate the area size of each region A i .
  • Set two thresholds of area size according to the image type, the smaller one named T l , and the larger one named T u .
  • If A i T l or A i T u , R i is determined as a false alarm target and is removed from the detection result. Otherwise, it can be a target and then move to the next region.
  • If all of the regions are tested, we can obtain the final detection result.

4. Experiment Results and Discussion

To evaluate our proposed algorithm quantitatively, we implemented experiments to three SAR images of inshore ships as shown in Figure 5. Figure 5a–c shows the images of Visakhapatnam port and its nearby waters in India acquired by the TerraSAR-X satellite in 2008. The detailed parameters (including the polarization, band, size, and resolution) of the three images are listed in Table 1. These three images are corrupted by speckle noise to different degrees, and contain a large number of land clutters. The performance of the algorithm was tested using MATLAB software on a computer equipped with a 2.8 GHz Intel i7 processor and 8.0 GB memory.

4.1. Results and Analysis of Fast Initialization

To reveal the advantages of the fast initialization, we rescale the image into one-quarter of the original image, and then we can obtain:
As revealed in Figure 6a, the original image contains lots of clutters (including speckle noise and land architectures).
Figure 6b is the contour map of the down-sample image. It has less clutters than Figure 6a, which is more beneficial for image segmentation. The red curve in Figure 6c is the initialization curve after image binarization and up sampling. Although it is a coarse curve compared with the true edge of ship targets and contains some clutters area, the ship targets have been roughly outlined.
This procedure has two advantages:
  • Down-sampling accelerates the speed of computation. Because the number of pixels in the image is greatly reduced.
  • Down-sampling can remove the influence of isolated clutter points. For example, rescale the image into one-quarter of the original image, noise whose size is less than one pixel will not appear in the rescaled image.
All those advantages result in getting a faster and better initialization curve, and a better initialization curve is beneficial to the evolution of the proposed LSM.

4.2. Results and Analysis of Proposed LSM

The proposed LSM is improved on the basis of the LBF model. In order to verify the validation of the improvement, the comparison between LBF model and the proposed LSM is analyzed in this section.
When calculating the saliency map, the size of ϖ takes 9 × 9 and the middle block sub0 takes 3 × 3 . In the level set evolution, the Gaussian kernel function σ takes 4, μ takes 1 and ν takes 0.001 × 255 2 , the time step Δ t takes 0.1.
In the calculation, the Heaviside function H is replaced by a smooth function H ε , which is defined by:
H ε ( x ) = 1 2 [ 1 + 2 π arctan ( x ε ) ]
where ε = 1 , the Dirac delta function δ is replaced by δ ε , which is defined by:
δ ε ( x ) = H ε ( x ) = 1 π ε ε 2 + x 2
To avoid the effects of initialization, the same initialization curve obtained in section 4.1 is used for these two methods. Through the calculation of LBF model and the proposed LSM, we can get level set function.
Level set function after LBF model and the proposed LSM use the same initialization curve, so the only difference is the improvement based on visual saliency. From Figure 7a,d, it can be seen that the targets in the result of proposed LSM are more salient. To display the results better, the mesh map and contour map of Figure 7a,d are shown in Figure 7b,c and 7e,f respectively. By comparing the Figure 7b,e or Figure 7c,f, we can conclude that the targets are more salient in the result of the proposed LSM (take the target in the red circus as an example). That is to say, the contrast between targets and background is larger after the improvement based on visual saliency.
The targets in the saliency map have higher signal-to-noise ratio than in the original image. The calculation of the proposed LSM is mainly based on the saliency map. Hence, the targets are more salient in the result of the proposed LSM.

4.3. Results and Analysis of Adaptive Threshold

MR images are segmented into two parts by level contour of ϕ = 0 . However, in this paper, adaptive threshold is used for ship detection. Therefore, zero ( ϕ = 0 ) and the adaptive threshold of the level set function are compared in this section.
In this article, all images are the same type, they are all inshore ship images with large ship targets. For our experimental images, the proportion of targets in the entire image ranges from 0.005 to 0.035, so p takes 0.06 for all images.
For image 1, though (14), p takes 0.06, then we can set the adaptive threshold T to 10. After the adaptive threshold of the level set function, candidate targets are obtained.
It can be visually observed that the result of the adaptive threshold (Figure 8b) has less clutters than zero level set function (Figure 8a). This is because the contrast between targets and background is larger after the improvement based on visual saliency, and appropriately raise the threshold can remove most clutters.
Moreover, the results of ship targets have good connectivity and integrity (Figure 8c). The reason for this property is that:
  • The level set method is an active contour model which aim to identify each region of interest by using a certain region descriptor to guide the motion of the active contour [26]. It is different from the method (like CFAR) which needs a pixel-by-pixel comparison, the result of it is consist of regions, so the level set method is more like a region detector.
  • The characteristics of the saliency map. For isolated dark spots in the ship targets, a higher saliency value can be obtained by the ILCM algorithm. Because in the formula (4), L n is the maximum value in the sub0 region, as long as there is one point with a high gray value in the sub0 region, then the salient value of dark spot become larger. In this way, the isolated dark spot inner the ship target also has a higher intensity in the saliency map.

4.4. Results and Analysis of Discrimination

Although the detection result in Figure 8c has preferable performance, it still contains some clutters with similar intensity to targets. Further discrimination based on the area size is required to get accurate ship targets.
Final detection results after discrimination and the final result curve in the original image are shown in Figure 9a,b, respectively. It can be seen all the ship targets have been detected, and the final detection result is accurate, integrity and almost has no clutter points. The detailed analysis of the result is described in the next section.

4.5. Results and Analysis of the Whole Proposed Method

4.5.1. Comparison with Other Two Ship Detection Methods

In order to validate the effectiveness of the proposed method, it is compared with K-CFAR and the Multiscale Variance Weighted Image Entropy (MVWIE) method [25]. K-CFAR is the traditional method of ship detection. K distribution is one of the most widely used models for statistical modeling of SAR images [29]. MVWIE is a state-of-the-art ship detection method based on multiscale local contrast measure (multiscale LCM) and information entropy, which can effectively detect ship targets from the complex background SAR images.
Firstly, the proposed method before discrimination is compared with K-CFAR and MVWIE. Then same discrimination described in Section 3.4 is employed to the results of these three methods.
Figure 10a, d are detection results of K-CFAR before and after discrimination. It can be seen that the detection result of K-CFAR is poor and some target pixels is missed. K-CFAR is more suitable for homogeneous background. Inshore ship images have many edges and architectures, so its performance is not preferable.
MVWIE performs well in detecting ships, but it also remains much clutters in the result (Figure 10b). Although most of the clutter can be removed after discrimination, there are still some clutters connected to the ship remained (Figure 10e). These clutters could change the shape of the ship in the final result, which results in an incorrect detection result.
The proposed method recognizes all the ship targets and there are some clutters in the detection result (Figure 10c). In contrast with K-CFAR and MVWIE, the final detection result of the proposed method has good connectivity and integrity for entire ship targets, and it almost has no land clutters connected with ships (Figure 10f).

4.5.2. Quantitative Evaluation

Additionally, in order to evaluate the proposed method quantitatively, the experimental results of these three methods are compared.
First, the detection rate ( P D ) and the false detection rate ( P F ) are used to evaluate the performance quantitatively [7]. Where:
P D = T p S p × 100 %
T p is the number of detected pixels belonging to the ship, and S p is the number of all these ship pixels. And:
P F = F p D p × 100 %
F p denotes the number of false alarm pixels, and D p is the number of all these detected pixels.
Without loss of generality, all the detection rate and false detection rate of the three methods on image 1–3 in Table 2 are derived under the same discrimination procedure (described in Section 3.4).
Table 2 shows the detection rate and false detection rate of these three methods based on image 1 (Figure 10d–f), image 2 (Figure 11d–f) and image 3 (Figure 12d–f).
As shown in Table 2, the results of K-CFAR have lower P F , but the P D is also lower. The results of MVWIE have higher P D , but the P F is also higher. However, the results of the proposed method have higher P D and lower P F at the same time.
Then, the efficiencies of the algorithms were compared. Table 3 reports the total time cost (include the discrimination procedure) for different methods.
As we can see in Table 3, for the same method, computational time is related to the sizes of images. In MVWIE method, multiscale LCM provides an ideal selection mechanism for the local optimal windows, the size of some windows could be a little large, so its computational time is longer than the K-CFAR method. Our proposed method uses ILCM with a fixed small window, but the iteration of level set method costs some time, so the computational time is little longer than the MVWIE method. However, the performance of the proposed method is much better than other two methods.

4.5.3. Generalization Ability of the Proposed Method

To further prove the generalization ability of the proposed method, we employed the proposed method to four more TerraSAR-X images as shown in Figure 13. Figure 13a–d show the images acquired by the TerraSAR-X satellite under different scenarios. The detailed parameters (including the polarization, band, size, resolution, acquisition location and acquisition year) of the SAR images are shown in Table 4.
The size and amount of land clutters are different in images of Figure 13, and these images are corrupted by speckle noise to different degrees due to their different acquisition conditions. The experiment results illustrate that our method also has effective performance on these images, and prove the generalization ability of the proposed method.

5. Conclusion

In this paper, an inshore ship detection method based on the level set and visual saliency is proposed. Firstly, to overcome the drawback of the LBF model, a fast initialization method is employed. Through down-sampling, the initialization method can speed up the computation and removes the influence of isolated clutters, which results in a better initialization curve. Secondly, an improved LSM based on visual saliency is proposed, the saliency map has a higher signal-to-noise ratio and the local level set method can effectively segment images with intensity inhomogeneity. Thirdly, the adaptive threshold rather than zero is used to obtain potential targets. Finally, ship targets are selected through the area discrimination. Experimental results show that the proposed method is robust to speckle noise, land clutters in SAR images and can detect ship targets with accuracy and integrity. Compared with K-CFAR and MVWIE, the proposed method has a higher detection rate and a lower false alarm rate. Experiments on a number of inshore ship images prove the generalization ability of the proposed method.
However, this paper focuses on the inshore ship with large sizes, the detection for tiny ship targets will be considered in the following work.

Author Contributions

Data curation, T.X.; Methodology, T.X. and L.Y.; Software, T.X., W.Z. and L.Y.; Validation, Q.W., J.H. and N.Y.; Writing – original draft, T.X., W.Z. and L.Y.; Writing – review & editing, Q.W., J.H. and N.Y.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wang, Q.; Zhu, H.; Wu, W.; Zhao, H.; Yuan, N. Inshore ship detection using high-resolution synthetic aperture radar images based on maximally stable extremal region. J. Appl. Remote Sens. 2015, 9, 095094. [Google Scholar] [CrossRef]
  2. Zhao, H.; Wang, Q.; Huang, J.; Wu, W.; Yuan, N. Method for inshore ship detection based on feature recognition and adaptive background window. J. Appl. Remote Sens. 2014, 8, 083608. [Google Scholar] [CrossRef]
  3. Shi, H.; Zhang, Q.; Bian, M.; Wang, H.; Wang, Z.; Chen, L.; Yang, J. A Novel Ship Detection Method Based on Gradient and Integral Feature for Single-Polarization Synthetic Aperture Radar Imagery. Sensors 2018, 18, 563. [Google Scholar] [CrossRef] [PubMed]
  4. Leng, X.; Ji, K.; Zhou, S.; Xing, X.; Zou, H. An Adaptive Ship Detection Scheme for Spaceborne SAR Imagery. Sensors 2016, 16, 1345. [Google Scholar] [CrossRef] [PubMed]
  5. Wang, J.; Lu, C.; Jiang, W. Simultaneous Ship Detection and Orientation Estimation in SAR Images Based on Attention Module and Angle Regression. Sensors 2018, 18, 2851. [Google Scholar] [CrossRef] [PubMed]
  6. An, Q.; Pan, Z.; You, H. Ship Detection in Gaofen-3 SAR Images Based on Sea Clutter Distribution Analysis and Deep Convolutional Neural Network. Sensors 2018, 18, 334. [Google Scholar] [CrossRef] [PubMed]
  7. Zhai, L.; Li, Y.; Su, Y. Inshore ship detection via saliency and context information in high-resolution SAR images. IEEE Geosci. Remote Sens. Lett. 2016, 13, 1870–1874. [Google Scholar] [CrossRef]
  8. Yu, L.; Fan, G.; Gong, J.; Havlicek, J.P. Joint Infrared Target Recognition and Segmentation Using a Shape Manifold-Aware Level Set. Sensors 2015, 15, 10118–10145. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Osher, S.; Sethian, J.A. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations. J. Comput. Phys. 1988, 79, 12–49. [Google Scholar] [CrossRef] [Green Version]
  10. Peng, D.; Merriman, B.; Osher, S.; Zhao, H.; Kang, M. A PDE-Based Fast Local Level Set Method. J. Comput. Phys. 1999, 155, 410–438. [Google Scholar] [CrossRef] [Green Version]
  11. Adalsteinsson, D.; Sethian, J.A. The Fast Construction of Extension Velocities in Level Set Methods. J. Comput. Phys. 1999, 148, 2–22. [Google Scholar] [CrossRef] [Green Version]
  12. Chan, T.; Vese, L. An active contour model without edges. In Scale-Space Theories in Computer Vision; Johansen, M., Olsen, P., Weickert, O.F., Eds.; Springer: Berlin, Germany, 1999; pp. 141–151. [Google Scholar]
  13. Li, C.; Kao, C.Y.; Gore, J.C.; Ding, Z. Implicit active contours driven by local binary fitting energy. In Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA, 17–22 June 2007; pp. 1199–1206. [Google Scholar]
  14. Li, C.; Kao, C.Y.; Gore, J.C.; Ding, Z. Minimization of region-scalable fitting energy for image segmentation. IEEE Trans. Image Process. 2008, 17, 1940–1949. [Google Scholar] [PubMed]
  15. Li, C.; Xu, C.; Gui, C.; Fox, M.D. Distance regularized level set evolution and its application to image segmentation. IEEE Trans. Image Process. 2010, 19, 3243–3254. [Google Scholar] [PubMed]
  16. Lv, H.; Wang, Z.; Fu, S.; Zhang, C.; Zhai, L.; Liu, X. A robust active contour segmentation based on fractional-order differentiation and fuzzy energy. IEEE Access 2017, 5, 7753–7761. [Google Scholar] [CrossRef]
  17. Wang, L.; Chen, G.; Shi, D.; Chang, Y.; Chan, S.; Pu, J.; Yang, X. Active contours driven by edge entropy fitting energy for image segmentation. Signal Process. 2018, 149, 27–35. [Google Scholar] [CrossRef]
  18. Yang, L.; An, W.; Lin, Z. Small Target Detection Based on Visual Saliency Improved by Spatial Distance. Acta Optica Sinica 2015, 35, 0715004. [Google Scholar] [CrossRef]
  19. Li, A.; Chen, Z. Personalized Visual Saliency: Individuality Affects Image Perception. IEEE Access 2018, 6, 16099–16109. [Google Scholar] [CrossRef]
  20. Li, X.; Li, D.; Yang, Z. A Patch-Based Saliency Detection Method for Assessing the Visual Privacy Levels of Objects in Photos. IEEE Access 2017, 5, 24332–24343. [Google Scholar] [CrossRef]
  21. Itti, L.; Koch, C.; Niebur, E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20, 1254–1259. [Google Scholar] [CrossRef] [Green Version]
  22. Chen, C.; Li, H.; Wei, Y. A local contrast method for small infrared target detection. IEEE Trans. Geosci. Remote Sens 2014, 52, 574–581. [Google Scholar] [CrossRef]
  23. Han, J.; Ma, Y.; Zhou, B. A Robust Infrared Small Target Detection Algorithm Based on Human Visual System. IEEE Trans. Geosci. Remote Sens. 2014, 1, 2168–2172. [Google Scholar]
  24. Nie, T.; He, B.; Bi, G. A Method of Ship Detection under Complex Background. ISPRS Int. J. Geo-Inf. 2017, 6, 159. [Google Scholar] [CrossRef]
  25. Wang, X.; Chen, C. Ship detection for complex background SAR images based on a multiscale variance weighted image entropy method. IEEE Geosci. Remote Sens. Lett. 2017, 14, 184–187. [Google Scholar] [CrossRef]
  26. Cheng, M.; Zhang, Z.; Lin, W. BING: Binarized normed gradients for objectless estimation at 300 fps. In Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition (CVPR), Columbus, OH, USA, 24–27 June 2014; pp. 3286–3293. [Google Scholar]
  27. Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef]
  28. Li, C.; Huang, R.; Ding, Z. A level set method for image segmentation in the presence of intensity inhomogeneities with application to MRI. IEEE Trans. Image Process. 2011, 20, 2007–2016. [Google Scholar] [PubMed]
  29. Qin, X.; Zhou, S.; Zou, H.; Gao, G. A CFAR Detection Algorithm for Generalized Gamma Distributed Background in High-Resolution SAR Images. IEEE Geosci. Remote Sens. Lett. 2013, 10, 806–810. [Google Scholar]
Figure 1. Results of LBF model with different initialization curves. (a) Initialization curve 1; (b) Result after 300 iterations with initialization curve 1; (c) Result after 3000 iterations with initialization curve 1; (d) Initialization curve 2; (e) Result after 300 iterations with initialization curve 2.
Figure 1. Results of LBF model with different initialization curves. (a) Initialization curve 1; (b) Result after 300 iterations with initialization curve 1; (c) Result after 3000 iterations with initialization curve 1; (d) Initialization curve 2; (e) Result after 300 iterations with initialization curve 2.
Sensors 18 03877 g001
Figure 2. The locations of sub-blocks in block ϖ .
Figure 2. The locations of sub-blocks in block ϖ .
Sensors 18 03877 g002
Figure 3. Flowchart of the proposed method.
Figure 3. Flowchart of the proposed method.
Sensors 18 03877 g003
Figure 4. Flowchart of the proposed fast initialization.
Figure 4. Flowchart of the proposed fast initialization.
Sensors 18 03877 g004
Figure 5. Experimental SAR images. (a) Image 1; (b) Image 2; (c) Image 3.
Figure 5. Experimental SAR images. (a) Image 1; (b) Image 2; (c) Image 3.
Sensors 18 03877 g005
Figure 6. Results of fast initialization. (a) Contour map of the original image; (b) Contour map of the down-sample image; (c) Result of initialization curve in the original image.
Figure 6. Results of fast initialization. (a) Contour map of the original image; (b) Contour map of the down-sample image; (c) Result of initialization curve in the original image.
Sensors 18 03877 g006
Figure 7. Results of LBF model (ac): (a) The level set function; (b) The mesh map of level set function; (c) The contour map of level set function. Results of the proposed LSM (df): (d) The level set function; (e) The mesh map of level set function; (f) The contour map of level set function.
Figure 7. Results of LBF model (ac): (a) The level set function; (b) The mesh map of level set function; (c) The contour map of level set function. Results of the proposed LSM (df): (d) The level set function; (e) The mesh map of level set function; (f) The contour map of level set function.
Sensors 18 03877 g007
Figure 8. Result after adaptive threshold. (a) Zero level set function (T = 0); (b) Adaptive threshold for level set function (T = 10 for image 1); (c) Detection result after adaptive threshold.
Figure 8. Result after adaptive threshold. (a) Zero level set function (T = 0); (b) Adaptive threshold for level set function (T = 10 for image 1); (c) Detection result after adaptive threshold.
Sensors 18 03877 g008
Figure 9. Results after discrimination (with threshold parameters T l sets to 100, and T u undesired). (a) Final detection result after discrimination; (b) Final detection result curve in original image.
Figure 9. Results after discrimination (with threshold parameters T l sets to 100, and T u undesired). (a) Final detection result after discrimination; (b) Final detection result curve in original image.
Sensors 18 03877 g009
Figure 10. Detection results of three methods for image 1 (ac): (a) K-CFAR; (b) MVWIE; (c) The proposed method. Detection results of three methods for image 1 after discrimination (df, with threshold parameters T l sets to 100, and T u undesired): (d) K-CFAR; (e) MVWIE; (f) The proposed method.
Figure 10. Detection results of three methods for image 1 (ac): (a) K-CFAR; (b) MVWIE; (c) The proposed method. Detection results of three methods for image 1 after discrimination (df, with threshold parameters T l sets to 100, and T u undesired): (d) K-CFAR; (e) MVWIE; (f) The proposed method.
Sensors 18 03877 g010
Figure 11. Detection results of three methods for image 2 (ac): (a) K-CFAR; (b) MVWIE; (c) The proposed method. Detection results of three methods for image 2 after discrimination (df, with threshold parameters T l sets to 500, and T u undesired): (d) K-CFAR; (e) MVWIE; (f) The proposed method.
Figure 11. Detection results of three methods for image 2 (ac): (a) K-CFAR; (b) MVWIE; (c) The proposed method. Detection results of three methods for image 2 after discrimination (df, with threshold parameters T l sets to 500, and T u undesired): (d) K-CFAR; (e) MVWIE; (f) The proposed method.
Sensors 18 03877 g011
Figure 12. Detection results of three methods for image 3 (ac): (a) K-CFAR; (b) MVWIE; (c) The proposed method. Detection results of three methods for image 3 after discrimination (df, with threshold parameters T l sets to 200, and T u undesired): (d) K-CFAR; (e) MVWIE; (f) The proposed method.
Figure 12. Detection results of three methods for image 3 (ac): (a) K-CFAR; (b) MVWIE; (c) The proposed method. Detection results of three methods for image 3 after discrimination (df, with threshold parameters T l sets to 200, and T u undesired): (d) K-CFAR; (e) MVWIE; (f) The proposed method.
Sensors 18 03877 g012
Figure 13. Generalization ability of the proposed method. The original images (ad): (a) Image 4; (b) Image 5; (c) Image 6; (d) Image 7. The detection results (eh): (e) Image 4 (with threshold parameters T l sets to 100, and T u undesired); (f) Image 5 (with threshold parameters T l sets to 100, and T u sets to 200); (g) Image 6 (with threshold parameters T l sets to 200, and T u undesired); (h) Image 7 (with threshold parameters T l sets to 1700, and T u undesired).
Figure 13. Generalization ability of the proposed method. The original images (ad): (a) Image 4; (b) Image 5; (c) Image 6; (d) Image 7. The detection results (eh): (e) Image 4 (with threshold parameters T l sets to 100, and T u undesired); (f) Image 5 (with threshold parameters T l sets to 100, and T u sets to 200); (g) Image 6 (with threshold parameters T l sets to 200, and T u undesired); (h) Image 7 (with threshold parameters T l sets to 1700, and T u undesired).
Sensors 18 03877 g013
Table 1. Parameters of the SAR images in Figure 5, where HH and VV denote the polarization models for horizontal transmit and horizontal receive, and vertical transmit and vertical receive, respectively.
Table 1. Parameters of the SAR images in Figure 5, where HH and VV denote the polarization models for horizontal transmit and horizontal receive, and vertical transmit and vertical receive, respectively.
Image NamePolarizationBandSize (pixels)Resolution
Image 1HHX235 × 2251.0 m × 1.0 m
Image 2HHX456 × 4071.0 m × 1.0 m
Image 3VVX200 × 2003.0 m × 3.0 m
Table 2. Detection rate and false detection rate of these three methods. ( P D / P F ).
Table 2. Detection rate and false detection rate of these three methods. ( P D / P F ).
ImageK-CFARMVWIEProposed Method
image 163.2/12.0 180.5/32.389.5/4.7
image 269.2/4.591.1/21.293.5/1.9
image 382.6/3.995.7/17.896.2/1.3
1 Detection rate /false detection rate.
Table 3. Time (in seconds) cost of the three algorithms on image 1–3.
Table 3. Time (in seconds) cost of the three algorithms on image 1–3.
ImageK-CFARMVWIEProposed Method
image 16.009.1411.46
image 210.4441.7245.61
image 34.689.189.53
Table 4. Parameters of the SAR images in Figure 13, where HH and VV denote the polarization models for horizontal transmit and horizontal receive, and vertical transmit and vertical receive.
Table 4. Parameters of the SAR images in Figure 13, where HH and VV denote the polarization models for horizontal transmit and horizontal receive, and vertical transmit and vertical receive.
ImagesPolarizationBandSize (pixels)ResolutionLocationYear
Image 4HHX364 × 2443.0 m × 3.0 mShanghai, China2010
Image 5VVX357 × 3813.0 m × 3.0 mKochi, India2008
Image 6HHX175 × 1161.0 m × 1.0 mVisakhapatnam, India2008
Image 7VVX331 × 2921.0 m × 1.0 mKerch, Russia2009

Share and Cite

MDPI and ACS Style

Xie, T.; Zhang, W.; Yang, L.; Wang, Q.; Huang, J.; Yuan, N. Inshore Ship Detection Based on Level Set Method and Visual Saliency for SAR Images. Sensors 2018, 18, 3877. https://0-doi-org.brum.beds.ac.uk/10.3390/s18113877

AMA Style

Xie T, Zhang W, Yang L, Wang Q, Huang J, Yuan N. Inshore Ship Detection Based on Level Set Method and Visual Saliency for SAR Images. Sensors. 2018; 18(11):3877. https://0-doi-org.brum.beds.ac.uk/10.3390/s18113877

Chicago/Turabian Style

Xie, Tao, Weike Zhang, Linna Yang, Qingping Wang, Jingjian Huang, and Naichang Yuan. 2018. "Inshore Ship Detection Based on Level Set Method and Visual Saliency for SAR Images" Sensors 18, no. 11: 3877. https://0-doi-org.brum.beds.ac.uk/10.3390/s18113877

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop