Next Article in Journal
Modelling Particle Motion during High-Voltage Electrostatic Abrasive Implantation Based on Multi-Physics Field Coupling
Previous Article in Journal
Analysis of 3-DOF Cutting Stability of Titanium Alloy Helical Milling Based on PKM and Machining Quality Optimization
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Composite Ski-Resort Registration Method Based on Laser Point Cloud Information

School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
*
Author to whom correspondence should be addressed.
Submission received: 21 April 2022 / Revised: 16 May 2022 / Accepted: 19 May 2022 / Published: 23 May 2022
(This article belongs to the Section Robotics, Mechatronics and Intelligent Machines)

Abstract

:
The environment of ski resorts is usually complex and changeable, and there are few characteristic objects in the background, which creates many difficulties for the registration of ski-resort point cloud datasets. However, in the traditional iterative closest point (ICP) algorithm, two points need to have good initial positions, otherwise it is easy to get caught up in local optimizations in registration. Aiming at this problem, according to the topographic features of ski resorts, this paper put forward a ski-resort coarse registration method based on extraction, and matching between feature points is proposed to adjust the initial position of two point clouds. Firstly, the feature points of the common part of the point cloud datasets are extracted based on the SIFT algorithm; secondly, the Euclidean distance between the feature normal vectors is used as the pairing condition to complete the pairing between the feature points in the point cloud datasets; then, the feature point pair is purified by using the included angle of the normal vector; finally, in the process of coarse registration, the rotation matrix and translation vector between point clouds are solved by the unit quaternion method. Experiments demonstrate that the proposed coarse registration method based on the normal vector of feature points is helpful to the smooth completion of the subsequent fine registration process, avoids the phenomenon of falling into local optimization, and effectively completes the ski-resort point cloud registration.

1. Introduction

With the successful holding of the 24th Beijing Winter Olympic Games in 2022, the enthusiasm of the masses to participate in winter sports has been greatly stimulated and, for all we know, the more typical winter sport is skiing. Accordingly, scientific research and participants related to skiing have achieved rapid growth in varying degrees [1,2,3].
In recent years, because of its high accuracy and efficiency, three-dimensional laser radar (Light Detection and Ranging, LiDAR) has been widely used in computer vision, cultural relic protection, reverse engineering and geographic mapping [4,5,6,7,8]. Additionally, according to the many advantages of LiDAR, it has become a new application direction to use the UAV LiDAR system to collect high-precision three-dimensional datasets of ski resorts [9,10], complete three-dimensional real scene reconstruction and realize snow track information extraction. The acquisition of 3D digital ski resorts is conducive to the daily maintenance of ski resorts (such as snow making, snow pressing, route planning, etc.) and the generation of e thvirtual scene in simulated training and entertainment system [11], which has great application prospects. The effective registration of ski-resort point cloud datasets collected by different sorties and routes has become an important foundation and key step of the ski-resort 3D reconstruction. Besides, because of the narrow visual surface of LiDAR sensor and the high spatial complexity of geographical entities, data acquisition based on LiDAR technology usually needs to be carried out along multiple perspectives [12,13], and then accomplishes the comprehensive expression of geographical entities based on the corresponding registration algorithm.
According to the different feature search space, the registration process can be summarized as global registration and local registration [14,15,16,17]. Global registration is usually based on local geometric features that can be uniquely matched without assuming an initial position. These features can be prearranged targets, scanning corners, lines, or planes in the scene [18]. The registration efficiency is high, but if the geometric conditions are insufficient and the feature distribution is uneven, the reliability of the registration results will be reduced. Local registration is to use the original point cloud to optimize the transformation matrix to obtain high matching accuracy when the position estimation of the two-point set is known [19]. Among them, the ICP algorithm is one of the most commonly used registration algorithms because of its simple steps, high precision and good robustness [20,21]. It has high requirements for the initial position between point clouds, and when the initial value error is large, it is easy to produce local optimization. Because the ICP algorithm directly uses the nearest sampling point in the point cloud datasets to establish the corresponding relationship, it has high requirements for the overlap of point clouds and takes a long time to search, so it cannot meet the application requirements when the amount of data is large [22,23,24,25].
Over the years, a considerable number of researchers and engineers at home and abroad have made a large number of improvements to the ICP algorithm. Men et al. changed the selection method of corresponding points by the Euclidean distance of point to point to the Euclidean distance of point to tangent plane, which improved the accuracy of registration, but the efficiency is still not high [26]. Koide et al. proposed the iterative dual correspondence (IDC) algorithm, which integrates the correspondence rules of the nearest point and matching distance point [27]. When the initial position is far away, IDC has better convergence than ICP, but when the initial position is close, its accuracy is lower than the ICP algorithm. Lei et al. put forward the algorithm of iterating the nearest segment and the nearest patch on the basis of ICP [28]. Firstly, the points in the two datasets are directly connected or triangulated, and then the corresponding line segment or triangular patch in the two datasets is found according to certain criteria, and the objective equation is established to calculate the rotation matrix. However, the stability of the algorithm used to find the corresponding relation criterion is yet to be verified. Rusu controlled the search range of the corresponding point set in the pre-divided cube grid, not only considering the curvature change of the point cloud, but also taking the information such as intensity, color and texture as the standard of point cloud registration [29].
In conclusion, considering that most registration algorithms converge on the assumption that the initial values of registration parameters are known and good, and when the initial values are incorrect, the algorithm cannot get the correct results; therefore, how to determine the initial value of the registration is a key. This paper presents a ski-resort point cloud registration algorithm based on the Euclidean distance and the included angle between the normal vectors of feature points. In the coarse registration stage, firstly, SIFT algorithm is used to extract feature points. Secondly, the Euclidean distance between the normal vectors of feature points is used as the judgment basis to automatically match the feature points of the ski-resort point cloud datasets. Then, the feature points are purified according to the topological relationship, that is, the included angle between the normal vectors of the feature points. Finally, the unit quaternion method is used to rotate and translate the two point clouds, so as to provide a good results for the subsequent fine registration work, which can effectively solve the problem of falling into local optimization and shorten the time of fine registration.

2. Study Area and Data

The LiDAR datasets used in this paper are acquired through the unmanned aircraft LiDAR System (RIEGL VUX-1 UAV System). The collection site is located in the Zhangjiakou Wanlong ski resort, the most famous ski resort in China, near Yanqing District, Beijing (249 km away from Beijing, 2110.3 m above sea level, more than 200,000 square meters). The collection time was 12:00 to 14:00 noon, and the temperature of the ski resort was −18 °C. Figure 1a shows the environmental conditions of the Wanlong ski resort at the time of collection, Figure 1b is an aerial picture taken from the air during acquisition, and Figure 2 is an introduction to the system architecture.
The seven ski-tracks of the Wanlong ski resort are all made of artificial snow, with high hardness. The environment of the snow field is relatively complex, including not only five main ski tracks, but also two training tracks, as well as trees, riprap, etc. DJI M600 PRO UAV is used as the flight platform with LiDAR, because of its excellent stability and flight performance, and its endurance time can reach 30 min. In the acquisition process, the scanning frequency of LiDAR was set to 550 KHz, the overlap rate of sidebands was 20 percent, the flight altitude was 110 m, the flight speed was 5 m/s and a total of two sorties were flown to complete the data acquisition.

3. Methodology

3.1. Coarse Registration of Point Cloud in Ski Resort

In order to get a good initial position, two pieces of the point cloud of the Wanlong ski resort need to be coarse-registered before fine registration.

3.1.1. SIFT Algorithm to Extract Feature Points

SIFT is a local feature descriptor proposed by David Lowe in 1999, and in 2004, has carried on further development and improvement [30,31,32,33]. SIFT features keep good invariance to rotation, translation, scale scaling, occlusion and brightness change, and are stable to visual change and affine transformation. In addition, it is especially suitable for high-speed and efficient matching in massive databases. The principle of SIFT algorithm can be simply described as: a picture in different scale space L ( x , y , σ ) is defined as the convolution of a gauss function G ( x , y , σ ) and the original picture I ( x , y ) . The relationship is as follows:
L ( x , y , σ ) = G ( x , y , σ ) I ( x , y )
In Formula (1), ( x , y ) represents the pixel position of the picture; ∗ is a convolution operation; σ is the scale space factor.An efficient gauss difference operator D ( x , y , σ ) is used for extremum detection to select stable key points, as follows:
D ( x , y , σ ) = ( G ( x , y , k σ ) G ( x , y , σ ) ) I ( x , y ) = L ( x , y , k σ ) L ( x , y , σ )
In Formula (2), k is a constant. The adjacent layers in DoG space are detected, and some extremum points that are detected together constitute the feature points. By comparing each pixel with 8 points of the same scale and 18 points of the adjacent scale, the extreme points of the DoG function can be found. If the DoG operator value of the pixel is an extreme value in the 26 neighborhood points, this pixel is defined as a feature point. At present, the feature points are the extreme points in the discrete space. Through the fitting of three-dimensional surface, the position and scale of feature points are accurately determined, low contrast feature points and unstable edge points are removed, the matching stability is enhanced and the anti noise ability is improved.
The least square fitting is carried out by using the DoG function in Taylor quadratic expansion:
D ( X ) = D + D T X X + 1 2 X T 2 D X 2
where X = ( x , y , σ ) T . If Equation (3) are equal to zero, we can get the offset of the extreme point:
X ^ = 2 D 1 X 2 D X
where X ^ = ( x , y , σ ) T is the relative offset of the interpolation center. If the offset of any dimension is not less than 0.5 (that is x, y, or σ ), this indicates that the interpolation center is already at other adjacent points, and the current critical point must be changed. Therefore, X ^ is used to calibrate the coordinates of the original feature points, and then the new coordinates after position correction are obtained.

3.1.2. Feature Point Matching of Point Cloud Datasets

After the feature points of the common part of the two point clouds are extracted, the feature points would be matched, and the Euclidean distance between the normal vectors is used to judge the similarity of the feature points in the cloud. Then, the Euclidean distance between the normal vector n i of the point cloud and n j of the feature points of the target cloud is calculated, and the two points with the smallest Euclidean distance are selected by comparing each other. If the preset threshold τ ( τ > 0 ) is greater than the minimum distance, then the nearest point pairs of the normal Euclidean distance between the feature points in the target and source point clouds are feature pairs. If the threshold is reduced, the number of matching point pairs will decrease, but the stability of matching will increase.
It should be noted that the normal vector of each feature points can be divided into positive and negative. Therefore, In order to keep the direction of the normal vector of the scanned object surface consistent, all the normal vectors are adjusted to satisfy n i · n j < 0 ( i j ) , so that the matching of feature points is more accurate.
The solution of normal vectors are based on the surface of points, ski-resort point cloud datasets are discrete points, and the information recorded in point clouds is the 3D coordinates of each independent point. Therefore, in order to obtain the normal vector of each feature point, the points within a certain radius near the point are fitted to the surface, and the normal vector of the target point is obtained on the basis of the fitting surface. The calculation process is as follows:
(1) For the n points ( x i , y i , z i ) , i = 1 , 2 , , n to be fitted, the fitted plane equation is:
a x + b y + c z = d , d 0
where a , b , c should satisfy a 2 + b 2 + c 2 = 1 . In addition, the distance from any point ( x i , y i , z i ) to the plane is:
d i = | a x i + b y i + c z i d |
(2) In order to obtain the best fitting plane, to meet the needs of the least squares, it is necessary to obtain the minimum sum of squares of all distances between each point and the plane, e = n d i 2 m i n , so that the problem of finding the normal vector can be transformed into that of finding the extremum:
f = n d i 2 μ ( a 2 + b 2 + c 2 1 )
(3) Taking the partial derivative of f with respect to four unknown parameters d , a , b , c , and then getting the unknown parameter d:
d = a i = 1 n x i n + b i = 1 n y i n + c i = 1 n z i n
(4) The distance from any point to the plane can be rewritten as:
d = a x i i = 1 n x i n + b y i i = 1 n y i n + c z i i = 1 n z i n
Let x ¯ = i = 1 n x i n , y ¯ = i = 1 n y i n , z ¯ = i = 1 n z i n , thereby:
d i = a ( x i x ¯ ) + b ( y i y ¯ ) + c ( z i z ¯ )
(5) Finding the partial derivative of formula (10) with respect to a , b and c:
f a = 2 i = 1 n a ( x i x ¯ ) + b ( y i y ¯ ) + c ( z i z ¯ ) ( x i x ¯ ) 2 μ a
Let Δ x i = x i x ¯ , Δ y i = y i y ¯ , Δ z i = z i z ¯ , it can be transformed into:
f a = 2 i = 1 n a Δ x i + b Δ y i + c Δ z i Δ x i 2 μ a
In addition,
f b = 2 i = 1 n a Δ x i + b Δ y i + c Δ z i Δ x i 2 μ b
f c = 2 i = 1 n a Δ x i + b Δ y i + c Δ z i Δ x i 2 μ c
(6) Combining Equation (12) to (14), it can be rewritten as:
Δ x i Δ x i Δ x i Δ y i Δ x i Δ z i Δ x i Δ y i Δ y i Δ y i Δ y i Δ z i Δ x i Δ z i Δ y i Δ z i Δ z i Δ z i a b c = μ a b c
Therefore, ( a , b , c ) T is the normal vector of the point in the plane.
If a feature point is selected from the target ski-resort datasets and its normal vector is ( a j , b j , z j ) T , the formula is the Euclidean distance between two normal vectors:
d i j = ( a i a j ) 2 + ( b i b j ) 2 + ( c i c j ) 2

3.1.3. Purification of Feature Points

The threshold set in the feature point pairing cannot completely and correctly correspond to the feature points one by one, and the phenomenon of false matching cannot be avoided. In theory, as long as 3 pairs of correct matching point pairs are extracted, an accurate rotation and translation matrix of ski-resort point cloud datasets can be obtained. However, if one pair of feature points is mismatched, there will be a great difference between the calculated transformation matrix and the actual transformation matrix. Therefore, in order to further improve the accuracy of the rotation matrix and translation vector, it is necessary to further purify the paired feature point pairs.
Currently, the most common algorithm for matching point refinement is the RANSAC algorithm (random sample consensus, RANSAC), which iterates through a set of observations containing outliers to estimate the parameters of the mathematical model. In addition, the point cloud datasets can be divided into valid data and invalid data. The RANSAC algorithm builds different models based on different data, the data satisfies the model, it is valid data; otherwise, it is invalid data. The results demonstrate that the model data obtained by this algorithm is robust and the parameters estimated by this algorithm are relatively accurate. However, the model fitted by this algorithm is different for different data every time, so it is not suitable for complex point cloud scene. Moreover, no upper limit is set on the number of iterations of the computational model. If the number of iterations is limited, the result may not be optimal or even wrong. Therefore, this paper adopts a matching point purification algorithm based on the included angle of the normal vector between the feature point pairs as the evaluation quantity. The included angle of normal vector between adjacent point clouds is affected by the slope value of the surface. The greater the slope, the greater the included angle. On the contrary, the smaller the slope, the smaller the included angle. The specific relationship is shown in Figure 3. Although the source ski-resort datasets and the target ski-resort datasets are in different spatial coordinate systems, their spatial topological relationship should be consistent. In addition to translation changes, there should also be a rotation relationship between the corresponding point clouds, and the included angle between the normal vectors should meet a certain mathematical relationship. Therefore, a threshold G is set in advance for the angle between the feature points and the normal vector to eliminate the mismatched points, so as to achieve the effect of purification.
For any pair of feature points A and B, their normal vectors are n A and n B , respectively. The greater the difference between the normal vectors, the smaller the cosine value of the included angle, and the smaller n A · n B . Therefore, the threshold G is set according to the cosine of the included angle between the normal vectors, and the point pairs whose product of the normal vectors is less than G are regarded as mismatched points and eliminated.
n A · n B G

3.1.4. Point Cloud Coordinate Transformation

When the feature points of the source ski-resort datasets and the target ski-resort datasets are matched one by one, the translation and rotation matrix should be calculated by using the feature point pairs. The commonly used three-dimensional coordinate transformation method obtains seven parameters by using the Boolean model, including three coordinate translation parameters, three angular rotation parameters and one scale parameter. Because the point cloud registration does not involve the size transformation of the point cloud scale, only the first six parameters are used to translate and rotate the source point cloud. However, this method contains the unstable error after linearization, the error of conversion parameter can be ignored only in the case of small angle conversion, and the precision cannot meet the requirement of conversion when the coordinate conversion angle is large. Therefore, the unit quaternion method is selected in this paper, which is more suitable for large angle three-dimensional coordinate transformation.
Quaternions are proposed by 1843, whose essence is a simple hypercomplex consisting of 1 real part unit and 3 imaginary part units [34,35,36]. When using the unit quaternion method to convert the three-dimensional coordinates of the point cloud, the common part of the two point clouds must be found, the rotation matrix and the translation vector of the overlapping part of ski-resort point cloud datasets must be obtained, so as to be applied to the conversion of the whole part of the source ski-resort datasets. The specific conditions for its use are: (1) The common parts A and B of the ski-resort point cloud datasets are selected, respectively, and the number of point clouds in A and B are equal; (2) the point cloud of A and B should meet the one-to-one correspondence, which means that A i and B i represent the same point in different coordinate systems. In the former part, the feature points of the common part of the source ski-resort datasets and the target ski-resort datasets are matched one by one, and the matching point pair can meet the requirements of the unit quaternion method. The specific algorithm of the unit quaternion method is as follows:
(1) Calculation the center of gravity of A and B point clouds, respectively, and the center of gravity coordinates are Z A and Z B .
Z A = 1 N i = 1 N A A i Z B = 1 N i = 1 N B B i
In Formulae (18), N A and N B are the number of point clouds in A and B, respectively. The number of points in two point clouds is required to be equal, as N A = N B .
(2) Calculation the covariance matrix of A and B:
R ( x ) = 1 n i = 1 n [ ( A i Z A ) ( B i Z B ) T ]
The covariance matrix obtained by Formula (19) can form a 4 × 4 symmetric matrix, Q ( R ) :
Q ( R ) = t r ( R ( x ) ) Δ T Δ R ( x ) + R ( x ) T + t r ( R ( x ) ) I 3
where t r ( R ( x ) ) is the trace of covariance matrix t r ( R ( x ) ) ; Δ = [ A 23 A 31 A 12 ] T , and A i j = ( R ( x ) R ( x ) T ) i j ; I 3 is a unit matrix of 3 × 3.
(3) The eigenvalues and eigenvectors of the symmetric matrix Q ( r ) are calculated and the eigenvectors corresponding to the largest eigenvalues are the rotation transformation vector q R = [ q 0 q 1 q 2 q 3 ] T . It should be noted that in the unit quaternion, q 0 > 0 , and q 0 2 + q 1 2 + q 2 2 + q 3 2 = 0 . The rotation matrix R ( q R ) can be calculated from q R :
R ( q R ) = q 0 2 + q 1 2 q 2 2 q 3 2 2 ( q 1 q 2 q 0 q 3 ) 2 ( q 1 q 3 + q 0 q 2 ) 2 ( q 1 q 2 + q 0 q 3 ) q 0 2 q 1 2 + q 2 2 q 3 2 2 ( q 2 q 3 q 0 q 1 ) 2 ( q 1 q 3 q 0 q 2 ) 2 ( q 2 q 3 + q 0 q 1 ) q 0 2 q 1 2 q 2 2 + q 3 2
(4) After obtaining the rotation matrix, the translation matrix q T can be solved:
q T = Z A R ( q R ) Z B
The rotation matrix R ( q R ) and the translation matrix q T are the transformation relationship between the source ski-resort datasets and the target ski-resort datasets. The rotation and translation matrix can be used to adjust the three-dimensional coordinates of the source point cloud, which provides a better initial position for the subsequent fine registration.

3.1.5. Overall Process of Coarse Registration Algorithm

Step 1: Identify the common overlaps A and B between the ski-resort point cloud datasets.
Step 2: The common points of A and B are extracted by the SIFT algorithm.
Step 3: Calculate the normal vectors of the feature points and unify their direction.
Step 4: Calculate the Euclidean distance between the normal vector of a feature point in A and the normal vector of all feature points in B, and select the two closest points. If the distance ratio is less than the threshold, the two points with the smallest distance will be matched.
Step 5: According to the spatial topological relationship of the point cloud, the included angles of the normal vectors between the matched feature points are calculated. According to the mathematical relationship, if it is larger than the set threshold, it will be regarded as the mismatching point and be rejected.
Step 6: Use the unit quaternion method to calculate the rotation matrix and translation vector. If the calculated quaternion does not meet q 0 > 0 and q 0 2 + q 1 2 + q 2 2 + q 3 2 = 0 , return to step (2) until the requirements are met.
Step 7: Apply the obtained rotation and translation matrix to the source ski-resort point clouds.

3.2. Fine Registration

After coarse registration, the point clouds of the ski-resort datasets have acquired a good initial position. On this basis, ICP iterative algorithm is introduced to improve the effect of fine registration [37,38]. The ICP algorithm calculates the motion parameters (rotation and translation) according to the geometric features between the source ski-resort datasets and the target ski-resort datasets, and then transforms the data with these motion parameters to get the new ski-resort point cloud datasets; in order to continue to determine the registration point cloud between the new correspondence, repeat the above process. The rotation and translation of ski-resort datasets will not stop until the minimum objective function meets the least square theorem. At this time, the registration effect is the best. The objective function is expressed as follows:
f ( T · R ) = 1 n i = 1 n P i ( Q i · T · R ) 2
where, T and R represent translation and rotation parameters, respectively; P i and Q i represent the target ski-resort datasets and source ski-resort datasets, respectively.

4. Results and Discussion

In order to verify the effectiveness of the above algorithm for the point cloud registration of ski resort, this paper takes two groups of laser-point cloud datasets from different locations of the Wanlong ski resort for the registration test. The algorithm in this paper is implemented by C++, and the program running environment is Intel core i5-9400f, DDR4 16 GB, 1080Ti and Windows 10. In order to quantitatively evaluate the registration accuracy of the algorithm, the root mean square error (RMSE) is defined to represent the difference between the features of the same name. The calculation formula is as follows:
R e = 1 N p i q i 2
In Formula (24), N is the number of overlapping points of two points to be registered after Euclidean transformation; p i , q i are the points of the overlapping region after Euclidean transformation.
In the verification process, the two groups of ski resort point clouds datasets are registered, respectively, and the threshold of feature point matching is set to 0.05, and the threshold of matching point pair purification is set to 0.8. The method proposed in this paper and ICP are used to register points, respectively; the registration results are shown in Figure 4 and the rotation matrix and translation vector are shown in Table 1.
According to the intersity information in the scalar field of the snow point clouds and the specific color scale, the experimental point cloud datasets are colored into different colors. Figure 4 represents the position distribution among the source point clouds in the first group of Wanlong ski resort, and Figure 5a is the registration results using the ICP, where red marked areas indicate poor registration results with significant obliquity and deviation, Figure 5b is the registration result by the method proposed in the paper. Additionally, the rotation matrix R and translation matrix T are also calculated, the Table 1 is the result of R and T, using the method proposed in this paper.
Figure 6 is the position distribution among the source point clouds in the second group of Wanlong ski resort, Figure 7a is the registration results using the ICP, where blue marked areas indicate poor registration results with significant obliquity and deviation; Figure 7b is the registration result by the proposed algorithm.
In addition, the rotation matrix R and translation matrix T are also calculated; the Table 2 is the result of R and T using the method proposed in this paper. The actual registration results demonstrate that this group of rotation translation matrix can realize the effective registration between the test ski-resort point cloud datasets.
Then, the registration results of the proposed method and ICP method are compared in terms of the number of point cloud datasets, processing time and RSME. The results are shown in the Table 3. It can be observed from the Table 3 that the number of point clouds of the first group of ski resort is 234,644 points. Under the same hardware conditions, the processing time of ICP method is 61.526 s, while the method proposed in this paper only takes 16.951 s; similarly, the RMSE of this group of data processed by ICP method is 1.619 m, while the RMSE obtained by our method is only 0.511.
In Figure 6 and Figure 7, when comparing the registration results of the ICP method and proposed method, we can find that there is obvious deviation in the results of ICP registration, and the results of the normal vector registration is better. This proves that the method proposed in this paper is more accurate than the ICP method in registration. In addition, in Table 1, it can be easily found that when processing the same set of data, the method proposed in this paper is more efficient in both the processing time and mean square error than the direct use of the ICP method. In conclusion, the proposed approach on the registration precision and registration efficiency is superior to directly using the ICP algorithm.
In addition, in order to further verify the effectiveness of the algorithm, the comparison is carried out from the dimension of the real error, that is, the real distance between the marked points is compared horizontally with the distance between the marked points in the registered three-dimensional model, and the measurement error is recorded. Taking the second group of ski-resort point cloud datasets as an example, five marker points are selected, namely A, B, C, D and E, and their distribution in the image and the point cloud is shown in Figure 8.
For the five marked points in Figure 8, two methods of field measurement with the meter ruler and three-dimensional measurement with point cloud processing tool are used successively.
In order to reduce the influence of error factors, the interval sampling measurement is carried out between the marked points (A, B, C, D and E) and the target marked points in turn. The measurement results are counted in Table 2 (here, it is considered that the field measurement value with the meter ruler is the true value).
Table 4 shows the error analysis and statistics of measuring the real distance, and measured the distance between marked points by tape measurement and point cloud measurement. From the analysis of the results in Table 4, it can be observed that with the increase in measuring distance, the proportion of measuring error will be reduced to a certain extent, and the error range is basically within 5 cm; the good adaptability and anti-noise performance of the proposed method in dealing with the point cloud in ski resorts are further verified.

5. Conclusions and Future Work

According to the complex environment of the Wanlong ski resort, this paper sets the threshold of the Euclidean distance and included angle between the adjacent normal vectors of point clouds, which can effectively accomplish the valid registration of the cloud point datasets of the ski resort. This composite registration method can extract the feature points by SIFT, pair them according to the Euclidean distance between normal vectors of points, set the included angle threshold for further purifying the feature point pairs, calculate the rotation and translation matrix, and finally, complete the fine registration with ICP. The results demonstrate that the proposed composite registration algorithm on paper is more accurate and effective than the direct ICP. The future work will focus on the research of the fine registration method of the point cloud datasets of ski resort, and expect to complete the automation of the whole registration process. Additionally, we will further study the snow characteristics to improve the theoretical foundation for the introduction of more efficient registration methods.

Author Contributions

Conceptualization, W.W. and H.Z.; methodology, W.W. and C.Z.; software, W.W.; validation, W.W., C.Z. and H.Z.; formal analysis, W.W.; investigation, W.W.; resources, C.Z.; data curation, W.W.; writing—original draft preparation, W.W.; writing—review and editing, C.Z.; visualization, W.W.; supervision, C.Z. and H.Z.; project administration, C.Z.; funding acquisition, C.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Key R&D Program of China, Special project of “Science and Technology Winter Olympics” (2018YFF0300802).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Miziński, B.; Niedzielski, T. Fully-automated estimation of snow depth in near real time with the use of unmanned aerial vehicles without utilizing ground control points. Cold Reg. Sci. Technol. 2017, 138, 63–72. [Google Scholar] [CrossRef]
  2. Pomerleau, F.; Colas, F.; Siegwart, R. A review of point cloud registration algorithms for mobile robotics. Found. Trends Robot. 2015, 4, 1–104. [Google Scholar] [CrossRef] [Green Version]
  3. Besl, P.J.; McKay, N.D. Method for registration of 3-D shapes. In Proceedings of the Sensor Fusion IV: Control Paradigms and Data Structures, Boston, MA, USA, 12–15 November 1991. [Google Scholar]
  4. Uy, M.A.; Lee, G.H. Pointnetvlad: Deep point cloud based retrieval for large-scale place recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–19 June 2019. [Google Scholar]
  5. Yang, P.; Ames, D.P.; Shrestha, R. Spatiotemporal analysis of stream network structure based on snow-on and snow-off LiDAR. In Proceedings of the AGU Fall Meeting, San Francisco, CA, USA, 9–13 December 2019. [Google Scholar]
  6. Yang, P.; Ames, D.P.; Shrestha, R. Teaser: Fast and certifiable point cloud registration. IEEE Trans. Robot. 2020, 37, 314–333. [Google Scholar] [CrossRef]
  7. Aoki, Y.; Goforth, H.; Srivatsan, R.A.; Lucey, S. Pointnetlk: Robust & efficient point cloud registration using pointnet. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019. [Google Scholar]
  8. Brown, L.G. A survey of image registration techniques. ACM Comput. Surv. (CSUR) 1992, 24, 325–376. [Google Scholar] [CrossRef]
  9. Vander Jagt, B.; Lucieer, A.; Wallace, L.; Turner, D.; Durand, M. Snow depth retrieval with UAS using photogrammetric techniques. Geosciences 2015, 5, 264–285. [Google Scholar] [CrossRef] [Green Version]
  10. Boesch, R.; Bühler, Y.; Marty, M.; Ginzler, C. Comparison of digital surface models for snow depth mapping with UAV and aerial cameras. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. ISPRS Arch 2016, 8, 453–458. [Google Scholar] [CrossRef] [Green Version]
  11. Jacobs, J.M.; Hunsaker, A.G.; Sullivan, F.B.; Palace, M.; Burakowski, E.A.; Herrick, C.; Cho, E. Snow depth mapping with unpiloted aerial system LiDAR observations: A case study in Durham, New Hampshire, United States. Cryosphere 2021, 15, 1485–1500. [Google Scholar] [CrossRef]
  12. Duan, Y.; Yang, C.; Chen, H.; Yan, W.; Li, H. Low-complexity point cloud denoising for LiDAR by PCA-based dimension reduction. Opt. Commun. 2021, 482, 126–567. [Google Scholar] [CrossRef]
  13. Sarode, V.; Li, X.; Goforth, H.; Aoki, Y.; Srivatsan, R.A.; Lucey, S.; Choset, H. Pcrnet: Point cloud registration network using pointnet encoding. arXiv 2021, arXiv:1908.07906. [Google Scholar]
  14. Belmonte, A.; Sankey, T.; Biederman, J.; Bradford, J.; Goetz, S.; Kolb, T. UAV-based estimate of snow cover dynamics: Optimizing semi-arid forest structure for snow persistence. Remote Sens. 2021, 13, 1036. [Google Scholar] [CrossRef]
  15. Huang, X.; Mei, G.; Zhang, J.; Abbas, R. A comprehensive survey on point cloud registration. arXiv 2021, arXiv:2103.02690. [Google Scholar]
  16. Obuchi, M.; Emaru, T.; Ravankar, A.A. Improved scan matching performance in snowy environments using semantic segmentation. In Proceedings of the 2021 IEEE/SICE International Symposium on System Integration (SII), Iwaki, Japan, 11–14 January 2021. [Google Scholar]
  17. Gelfand, N.; Mitra, N.J.; Guibas, L.J.; Pottmann, H. Robust global registration. In Proceedings of the Symposium on Geometry Processing, Vienna, Austria, 4–6 July 2005. [Google Scholar]
  18. Razali, A.F.; Ariff, M.F.M.; Majid, Z. A Hybrid Point Cloud Reality Capture from Terrestrial Laser Scanning and Uav-Photogrammetry. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2022, 46, 459–463. [Google Scholar] [CrossRef]
  19. Ye, Z.; Liu, C.; Tian, W.; Kan, C. In-situ point cloud fusion for layer-wise monitoring of additive manufacturing. J. Manuf. Syst. 2021, 61, 210–222. [Google Scholar] [CrossRef]
  20. Min, T.; Song, C.; Kim, E.; Shim, I. Distinctiveness oriented positional equilibrium for point cloud registration. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada, 11–17 October 2021. [Google Scholar]
  21. Li, J.; Hu, Q.; Ai, M. Point cloud registration based on one-point ransac and scale-annealing biweight estimation. IEEE Trans. Geosci. Remote Sens. 2021, 59, 9716–9729. [Google Scholar] [CrossRef]
  22. Efraim, A.; Francos, J.M. Dual Transformation and Manifold Distances Voting for Outlier Rejection in Point Cloud Registration. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada, 11–17 October 2021. [Google Scholar]
  23. Kukko, A.; Anttila, K.; Manninen, T.; Kaasalainen, S.; Kaartinen, H. Snow surface roughness from mobile laser scanning data. Cold Reg. Sci. Technol. 2013, 96, 23–35. [Google Scholar] [CrossRef]
  24. Wu, B.; Ma, J.; Chen, G.; An, P. Feature Interactive Representation for Point Cloud Registration. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada, 11–17 October 2021. [Google Scholar]
  25. Larsson, H.; Steinvall, O.K.; Chevalier, T.R.; Gustafsson, F. Characterizing laser radar snow reflection for the wavelengths 0.9 and 1.5 μm. Opt. Eng. 2006, 45, 116201. [Google Scholar] [CrossRef]
  26. Men, H.; Gebre, B.; Pochiraju, K.K. Color point cloud registration with 4D ICP algorithm. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011. [Google Scholar]
  27. Koide, K.; Yokozuka, M.; Oishi, S.; Banno, A. Voxelized gicp for fast and accurate 3d point cloud registration. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, 30 May–5 June 2021. [Google Scholar]
  28. Lei, H.; Jiang, G.; Quan, L. Fast descriptors and correspondence propagation for robust global point cloud registration. IEEE Trans. Image Process. 2017, 26, 3614–3623. [Google Scholar] [CrossRef] [PubMed]
  29. Rusu, R.B.; Blodow, N.; Beetz, M. Fast point feature histograms (FPFH) for 3D registration. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Kobe, Japan, 12–17 May 2009. [Google Scholar]
  30. Gressin, A.; Mallet, C.; Demantké, J.; David, N. Towards 3D LiDAR point cloud registration improvement using optimal neighborhood knowledge. ISPRS J. Photogramm. Remote Sens. 2013, 79, 240–251. [Google Scholar] [CrossRef] [Green Version]
  31. Huang, X.; Mei, G.; Zhang, J. Feature-metric registration: A fast semi-supervised approach for robust point cloud registration without correspondences. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020. [Google Scholar]
  32. Elbaz, G.; Avraham, T.; Fischer, A. 3D point cloud registration for localization using a deep neural network auto-encoder. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
  33. Xin, W.; Pu, J. An improved ICP algorithm for point cloud registration. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Chengdu, China, 17–19 December 2010. [Google Scholar]
  34. Fu, K.; Liu, S.; Luo, X.; Wang, M. Robust point cloud registration framework based on deep graph matching. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20–25 June 2021. [Google Scholar]
  35. Zaganidis, A.; Sun, L.; Duckett, T.; Cielniak, G. Integrating deep semantic segmentation into 3-d point cloud registration. IEEE Robot. Autom. Lett. 2018, 3, 2942–2949. [Google Scholar] [CrossRef] [Green Version]
  36. Quan, S.; Yang, J. Compatibility-guided sampling consensus for 3-d point cloud registration. IEEE Trans. Geosci. Remote Sens. 2020, 58, 7380–7392. [Google Scholar] [CrossRef]
  37. Xiao, J.; Adler, B.; Zhang, H. 3D point cloud registration based on planar surfaces. In Proceedings of the 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Hamburg, Germany, 13–15 September 2012. [Google Scholar]
  38. Truong, G.; Gilani, S.Z.; Islam, S.M.S.; Suter, D. Fast point cloud registration using semantic segmentation. In Proceedings of the 2019 Digital Image Computing: Techniques and Applications (DICTA), Canberra, Australia, 10–13 December 2019. [Google Scholar]
Figure 1. Collection point cloud datasets in the ski resort; (a) shows the environmental conditions of the Wanlong ski resort at the time of collection; (b) is an aerial picture taken from the air during acquisition.
Figure 1. Collection point cloud datasets in the ski resort; (a) shows the environmental conditions of the Wanlong ski resort at the time of collection; (b) is an aerial picture taken from the air during acquisition.
Machines 10 00405 g001
Figure 2. Structure diagram of point cloud acquisition system, which mainly includes inertial navigation, DGPS, camera and laser scanning.
Figure 2. Structure diagram of point cloud acquisition system, which mainly includes inertial navigation, DGPS, camera and laser scanning.
Machines 10 00405 g002
Figure 3. The influence of the included angle between adjacent normal vectors on the slope in this region; (a) the larger angle of the normal vector of the point cloud in the local region indicates that the region is more undulating; (b) the small change of the normal vector angle indicates that the region is relatively flat.
Figure 3. The influence of the included angle between adjacent normal vectors on the slope in this region; (a) the larger angle of the normal vector of the point cloud in the local region indicates that the region is more undulating; (b) the small change of the normal vector angle indicates that the region is relatively flat.
Machines 10 00405 g003
Figure 4. The position distribution among the source point clouds in the first group of Wanlong ski resort.
Figure 4. The position distribution among the source point clouds in the first group of Wanlong ski resort.
Machines 10 00405 g004
Figure 5. Registration results using different methods in group one: (a) Registration result by ICP; (b) registration result by the method proposed in the paper.
Figure 5. Registration results using different methods in group one: (a) Registration result by ICP; (b) registration result by the method proposed in the paper.
Machines 10 00405 g005
Figure 6. The position distribution among the source point clouds in the second group of Wanlong ski resort.
Figure 6. The position distribution among the source point clouds in the second group of Wanlong ski resort.
Machines 10 00405 g006
Figure 7. Registration results using different methods in group two: (a) Registration result by ICP; (b) registration result by the method proposed in the paper.
Figure 7. Registration results using different methods in group two: (a) Registration result by ICP; (b) registration result by the method proposed in the paper.
Machines 10 00405 g007
Figure 8. The distribution of marker points in the visible light image of the ski resort and the three-dimensional point cloud after registration: (a) the distribution in the visible top view; (b) the distribution in point cloud model.
Figure 8. The distribution of marker points in the visible light image of the ski resort and the three-dimensional point cloud after registration: (a) the distribution in the visible top view; (b) the distribution in point cloud model.
Machines 10 00405 g008
Table 1. The rotation and translation matrix of the first group of ski-resort point clouds calculated based on the method proposed in this paper.
Table 1. The rotation and translation matrix of the first group of ski-resort point clouds calculated based on the method proposed in this paper.
Rotation Matrix Translation Vector
R0.999−0.0100.005T4.644
0.0100.9990.002−4.868
−0.005−0.0020.9993.819
0001.000
Table 2. The rotation and translation matrix of the second group of ski-resort point clouds calculated based on the method proposed in this paper.
Table 2. The rotation and translation matrix of the second group of ski-resort point clouds calculated based on the method proposed in this paper.
Rotation Matrix Translation Vector
R1.010−0.0100.007T119.057
0.0101.0100.00378.767
−0.007−0.0031.010−3.616
0001.000
Table 3. Comparison of the registration results between the proposed method and ICP method.
Table 3. Comparison of the registration results between the proposed method and ICP method.
Name of
Points
Number of
Points
Process Time /sRSME /m
ICP MethodProposed MethodICP MethodProposed Method
Group one234,64461.52616.9511.6190.511
Group two212,97741.23510.9621.5960.447
Table 4. Statistical table for error analysis of measuring distance between mark points in different ways.
Table 4. Statistical table for error analysis of measuring distance between mark points in different ways.
Marked PointsTarget PointsTrue Distance /mMeasured Distance /mError Value /m
AC17.22417.2520.028
E37.80537.8440.039
BD18.46218.4560.006
E30.86830.8350.033
CA17.22417.2700.046
E20.72520.6980.027
DA38.22538.2520.027
B18.46218.4320.030
EA37.80537.8390.034
C20.72520.7010.024
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, W.; Zhao, C.; Zhang, H. Composite Ski-Resort Registration Method Based on Laser Point Cloud Information. Machines 2022, 10, 405. https://0-doi-org.brum.beds.ac.uk/10.3390/machines10050405

AMA Style

Wang W, Zhao C, Zhang H. Composite Ski-Resort Registration Method Based on Laser Point Cloud Information. Machines. 2022; 10(5):405. https://0-doi-org.brum.beds.ac.uk/10.3390/machines10050405

Chicago/Turabian Style

Wang, Wenxin, Changming Zhao, and Haiyang Zhang. 2022. "Composite Ski-Resort Registration Method Based on Laser Point Cloud Information" Machines 10, no. 5: 405. https://0-doi-org.brum.beds.ac.uk/10.3390/machines10050405

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop