Next Article in Journal
Development of the Indian Future Weather File Generator Based on Representative Concentration Pathways
Next Article in Special Issue
Application of Extended Set Pair Analysis on Wear Risk Evaluation of Backfill Pipeline
Previous Article in Journal
Is Contract Farming with Modern Distributors Partnership for Higher Returns? Analysis of Rice Farm Households in Taiwan
Previous Article in Special Issue
Detection Method of Crushing Mouth Loose Material Blockage Based on SSD Algorithm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Modeling and Simulation of Unmanned Driving System for Load Haul Dump Vehicles in Underground Mines

School of Resources and Safety Engineering, Central South University, Changsha 410083, China
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(22), 15186; https://0-doi-org.brum.beds.ac.uk/10.3390/su142215186
Submission received: 22 September 2022 / Revised: 10 November 2022 / Accepted: 12 November 2022 / Published: 16 November 2022
(This article belongs to the Special Issue Advances in Intelligent and Sustainable Mining)

Abstract

:
This paper proposes the modeling and simulation of the unmanned driving system for underground load haul dump vehicles based on Gazebo/Ros. Firstly, the kinematics model of the load haul dump vehicle is derived. Then, the model of each part of the load haul dump vehicle is established based on SolidWorks and the model of the load haul dump vehicle is established by connecting the parts through a unified robot description format (URDF) file. Finally, the laneway model is established by using alpha shape to realize the modeling of the operating environment of the load haul dump vehicle. The speed, angular speed, bucket lifting, and bucket flipping of the load haul dump vehicle are controlled using PID. The experimental results show that: The control errors of the speed and angular speed of the load haul dump vehicle are 0.283 m/s and 0.010 rad/s, respectively. The control error of the lifting bucket is 0.025 m and that of the flipping bucket is 0.015 m. The angular velocity control error of the simulation system relative to the actual system is 0.330 and 0.106 m/s, respectively. The error between the SLAM of the simulation system and the actual system and the measured value is 0.917 and 3.44 m, respectively. The control performance of the load haul dump vehicle in the simulation system is good. Therefore, automatic driving algorithms can be studied and tested in this simulation platform.

1. Introduction

Load haul dump (LHD) vehicles are very important equipment in underground mines. Ore and minerals are usually dumped from the working face by LHD vehicles into the ore pass. Therefore, driving LHD vehicles requires a lot of manpower. Moreover, the working environment is harsh, which can seriously threaten the health of the driver: a large amount of dust in the laneway affects the respiratory system and the noise generated by the machinery hurts the hearing system. Although more and more battery-powered LHD vehicle chargers are being developed [1,2,3], most mines currently use the hydraulic LHD vehicles. In recent years, with the development of science and technology, unmanned LHD vehicles have become a research hotspot and they have solved the above problems. In addition, with the progress of human civilization, governments of various countries have paid more and more attention to human rights and issued relevant policies, which have promoted the intelligent process of mine automation. For example, in April 2020, the Ministry of Industry and Information Technology of China, the National Development and Reform Commission, and the Ministry of Natural Resources jointly announced the Guidelines for the Construction of Intelligent Factories (Mines) in the Nonferrous Metals Industry (Trial). Scholars have performed a lot of research and analysis on the core technology of unmanned LHD vehicles [4,5,6,7,8]. For example, Rowduru [9] reviews the automation of the steering mechanism for LHD vehicles and Gao [10] analyzes the steering characteristics. Altafini [11] proposes a path tracking criterion for an articulated LHD vehicle and Yu [12] compares and optimizes the path tracking control algorithm of the LHD vehicle. The literature [13,14] researches the navigation and location algorithm of LHD vehicles. In general, the following conditions need to be met for automatic driving algorithm testing: The first is hardware support, including automatic driving LHD vehicles, laser radar, camera, and other sensors. The second is the support of a good network. The data transmission between sensors requires a network. The third is the real test environment. The fourth is professional testers. Meeting the above conditions will not only consume manpower, material, and financial resources but also delay the progress of the project. Therefore, the unmanned driving simulation platform plays an important role in algorithm tests [15].
Nowadays, modeling and simulation are important parts of science and engineering. Especially in the aerospace field, simulation is an indispensable technique and plays a vital role. At present, in the field of robotics, there is a lot of simulation software, such as Carsim, Robot Virtual Worlds, NVIDIA ISAAC Platform for Robotics, Virtual Robot Experimentation Platform (V-REP), Webots, and Gazebo. Scholars have carried out different types of modeling simulation and algorithm research on these simulation platforms. Mashadi [16] studied the ground vehicle path planning algorithm based on Carsim simulation software. Rivera [17] modeled and simulated the ground-wheeled robot based on the Gazebo simulation platform. Botelho [18] studied a multi-agent multi-robot system based on the V-REP platform. In robotics research projects, Gazebo is the most widely used. Gazebo is a multi-robot simulation tool that can accurately and efficiently simulate the number of robots, sensors, and objects in the 3D world [19]. In addition, Gazebo has a powerful physics engine, provides various types of sensor plug-ins and supports the Robot Operating System (ROS). Gazebo/Ros have been widely used in many robotics research projects [20,21,22,23,24]. For example, based on Gazebo/Ros, Iqbal [25] adopted a hybrid strategy combining GPS waypoint tracking and lidar navigation and successfully implemented robot navigation in farmland.
However, there are few examples in the literature addressing the simulation of the unmanned driving system of LHD vehicles in underground mines so far. In order to fill this research gap, this paper proposes the modeling and simulation of the unmanned driving system of the underground LHD vehicles based on the Gazebo simulation platform. This simulation system mainly includes two parts. The first is the modeling of the LHD vehicle. Li [26] established a three-dimensional model of the working linkage of the LHD vehicle based on Solidworks software. A closed-loop kinematic chain structure is included in the LHD model, but Gazebo does not support this structure [27]. Therefore, the Gazebo plugin written in this article successfully solves this problem. The second is laneway modeling. We propose a novel modeling method based on Livox horizon lidar, which accurately establishes the 3D model of the laneway. The specific structure of this paper is as follows.
In Section 2, we firstly deduce the kinematics model of the LHD vehicle according to the law of the LHD’s motion. Based on Gazebo, an LHD model is established and the problem that Gazebo does not support the closed-loop kinematic chain structure is solved. A novel approach is then used to model the laneway in Gazebo. Finally, the ros_control Ros package is used to control the movement of the LHD model in Gazebo and the simulation of the unmanned driving system of the LHD vehicle is realized. In Section 3, we analyze the performance of the simulation system quantitatively through four experiments, verify the kinematics model, and test the simultaneous localization and mapping (SLAM) algorithm on the simulation system. In Section 4, we discuss and analyze some of the problems of the experiments in Section 3. Section 5 summarizes the research work and conclusions of this paper.

2. Materials and Methods

In this section, we describe and model the unmanned driving system of the LHD vehicle in underground mines. It mainly includes four parts. The first part is the kinematic model of the LHD vehicle. Since the LHD models are all articulated, which is different from the car model, we analyze the kinematics of the LHD vehicle and derive the kinematic model of the LHD vehicle. The second part is the model of the LHD. We used Solidworks to build the 3D model of each part of the LHD vehicle and spliced the parts into the LHD model in the URDF file. The principle of interaction between linkage in the forward steering process of LHD vehicle is analyzed. In addition, we use the Gazebo plug-in to connect lidar, cameras, and IMUs to the LHD model. The third part is laneway modeling. The underground laneway is the environment where the LHD vehicle drives automatically. In order to ensure the environment is consistent with the real environment, we build a point cloud model using 3D SLAM through Livox Horizon lidar and use the alpha shape algorithm [28,29] to convert the point cloud model into a triangular patch model. The fourth part is the simulation of the unmanned driving system of the LHD vehicle in Gazebo. In order to cause the LHD vehicle to move in the Gazebo environment, we use the Gazebo plug-in to control the rotation of the wheel and control the steering and shovel loading of the LHD vehicle through the ros_control Ros package.

2.1. The LHD Kinematics Model

The underground LHD vehicles generally drive at speeds below 30 km/h and the kinematics model can describe the driving state of the LHD vehicle more accurately [30,31]. As shown in Figure 1, it represents the driving state of the LHD vehicle. In the figure, F and R are the center points of the front and rear wheels, respectively. ( x f , y f ) , ( x r , y r ) are the coordinates of F and R, respectively. v f , v r are the speeds of F and R, respectively. C is the hinge point. γ is the hinge radian that is positive for turning left and negative for turning right. θ f , θ r represent the heading radian of the front and rear axles, respectively. l f , l r represent the length of the front and rear axles, respectively. d represent the wheelbase.
Decompose v f , v r into:
x f = v f cos ( π θ f )
y f = v f sin ( π θ f )
x r = v r cos ( π θ r )
y r = v r sin ( π θ r )
From Figure 1, the F, R coordinate relationship can be obtained:
x r l r cos ( π θ r ) l f cos ( π θ f ) = x f
y r + l r sin ( π θ r ) + l f sin ( π θ f ) = y f
Combining Equations (1)–(4), we receive:
x f sin ( π θ f ) + y f cos ( π θ f ) = 0
x r sin ( π θ r ) + y r cos ( π θ r ) = 0
It can be obtained from Figure 1:
θ f = θ r + γ
Equations (5) and (6) are derived from time to obtain:
x ˙ r l r sin ( θ r ) θ ˙ r l f sin ( θ f ) θ ˙ f = x ˙ f
y ˙ r + l r cos ( θ r ) θ ˙ r + l r cos ( θ f ) θ ˙ f = y ˙ f
Combining Equations (1), (2) and (8)–(11), we can obtain:
l r θ ˙ f l r γ ˙ + l f θ ˙ f cos ( γ ) = v f sin ( γ )
θ ˙ f = v f sin ( γ ) + l r γ ˙ l r + l f cos ( γ )
From Equations (9) and (12) we can receive:
θ ˙ r = v f sin ( γ ) l f γ ˙ cos ( γ ) l r + l f cos ( γ )
Comprehensive Equations (3), (4), (7) and (9)–(11) can be obtained:
v r sin ( γ ) l r θ ˙ r cos ( γ ) l f θ ˙ f = 0
From Equations (13)–(15) we can receive:
v r = l f l r γ ˙ sin ( γ ) + ( l f + l r cos ( γ ) ) v f l r + l f cos ( γ )
According to the above derivation, the center point F of the front wheel is the reference point and the kinematic model of the LHD can be represented by Equation (17).
[ x ˙ f y ˙ f θ ˙ f γ ˙ ] = [ cos ( θ f ) 0 sin ( θ f ) 0 sin ( γ ) l r + l f cos ( γ ) l r l r + l f cos ( γ ) 0 1 ] [ v f γ ˙ ]

2.2. The LHD Modeling

LHD vehicles are essential transportation tools for mining. Due to the narrow underground laneway, in order to enable the LHD vehicle to turn flexibly in the narrow laneway, the LHD vehicle is all articulated. At present, the unmanned LHD vehicle is still in the initial stage of industrial application and there is no large-scale production. Therefore, in order to study the unmanned driving of the LHD vehicle, we transformed the traditional LHD vehicle, as shown in Figure 2. We installed a camera and a lidar on each of the front body and the rear body. The camera is a device that provides the driver with a view when remotely controlling the LHD vehicle. The lidar has a scanning range of 270 degrees and it is the main sensor for the unmanned driving of the LHD vehicle. Intelligent controllers, IMUs, network communication, and other equipment are installed in a box in the rear body.
We split the LHD vehicle into 24 parts, modeled each part in Solidworks, and then connected the parts through the URDF file. The naming of each linkage is shown in Figure 2. The relationship between each linkage of the LHD vehicle is shown in Figure 3. The dotted line in the figure represents five closed-loop kinematic chain models [32], which are
  • base_footprint—CB_Link—Z3_Link—Z2_Link—Z1_Link;
  • base_footprint—CB_Link—L2_Link—L1_Link;
  • CB_Link—Z3_Link—Z4_Link—CD_Link;
  • base_footprint—C1_Link—C2_Link—CH_Link;
  • base_footprint—C3_Link—C4_Link—CH_Link.
Since the closed-loop kinematic chain model cannot be defined in the URDF file, we used URDF to define the connection of the two links represented by the solid line in Figure 3 and used the Gazebo plugin to define the connection of the two links represented by the dotted line in Figure 3. The function package of the Gazebo closed-loop plug-in developed by us combined with the URDF file can realize the simulation of a closed-loop motion chain structure in Gazebo.
Then, we described the motion principle of the LHD vehicle from the perspective of linkage motion. The LHD operation is divided into two processes. The first is the shovel loading process and the second is the driving process.
The motion principle of the LHD during the shovel loading process is shown in Figure 4a. The shovel loading is divided into two actions. The first is to lift the bucket and the second is to flip the bucket. The lifting bucket is controlled by the movement of the L2_Link in the L1_Link. When the length of the L2_Link in the L1_Link is shortened, the generated lift makes the front frame rise, and the entire front frame will rotate counterclockwise around O 1 , O 2 . Conversely, when the length of the L2_Link becomes longer in the L1_Link, the generated descending force will lower the front frame, and the entire front frame will rotate clockwise around O 1 , O 2 . The flipping bucket is controlled by the movement of the Z2_Link in the Z1_Link. When the length of the Z2_Link in the Z1_Link becomes shorter, the Z3_Link will rotate counterclockwise around O 6 , and then the force generated by the Z4_Link makes the CD_Link rotate counterclockwise around O 9 . Conversely, when the length of the Z2_Link in the Z1_Link becomes longer, the Z3_Link will rotate clockwise around O 6 , and the force generated by the Z4_Link will cause the CD_Link to rotate clockwise around O 9 .
The motion principle of the LHD vehicle during driving is also divided into two parts. The first one is the steering control principle, as shown in Figure 4b. When the length of the C1_Link in the C2_Link becomes shorter, the length of the C3_Link in the C4_Link becomes longer. The base_link rotates clockwise around O 12 . The CH_Link rotates counterclockwise around O 12 and the LHD vehicle turns right. Conversely, when the length of the C1_Link in the C2_Link becomes longer, the length of the C3_Link in the C4_Link will become shorter. The base_link will rotate counterclockwise around O 12 . The CH_Link will rotate clockwise around O 12 and the LHD vehicle will turn left. The second is the principle of longitudinal speed control. Obviously, the forward speed of the LHD vehicle is controlled by the rotation speed of the wheels. In the simulation model, we control the longitudinal speed and steering angular speed of the LHD vehicle by controlling the different rotational speeds of the four wheels. As shown in Figure 1, we use F as the reference point, v f represents the speed of the vehicle, and we can obtain the angular speed of the four wheels:
w l f w = v f ( d / 2 ) θ ˙ f R w r f w = v f + ( d / 2 ) θ ˙ f R w l r w = v r ( d / 2 ) θ ˙ r R w r r w = v r + ( d / 2 ) θ ˙ r R
In Equation (18), R represents the radius of the wheel and w l f w , w r f w , w l r w , w r r w are the angular velocities of the left front wheel, the right front wheel, the left rear wheel, and the right rear wheel, respectively.
Finally, we add the corresponding sensors model to the LHD model according to the position of the sensors in Figure 2. Camera, lidar, and IMUs models in were added to the URDF files through the Gazebo plugin as shown in Figure 5. The frequency of the lidar is set to 50 Hz. The frequency of the IMUs is set to 100 Hz and the frequency of the camera is set to 30 Hz.

2.3. Laneway Modelling

The underground laneway environment is harsh. The laneway is filled with a lot of dust during mining operations and the ground is uneven, as shown in Figure 6a. In order to ensure the simulation environment is consistent with the actual laneway environment, we also performed in-depth research on laneway modeling. The laneway modeling process is shown in Figure 6b. First, we used the Livox Horizon lidar to scan part of the laneway of a mine and used LiLi-OM [33] to generate a point cloud model. Then, we de-noised the point cloud model and used the alpha shape algorithm to build a triangular mesh model. Then, we visualized and converted the model to ADE format using 3D software. Finally, we loaded the ADE file through the URDF file and displayed it in Gazebo. The specific description is as follows.
During the process of lidar data acquisition and 3D SLAM algorithm mapping, some interference points were generated, as shown in the red circle in Figure 7a. The interference points had a great impact on the quality of laneway modeling and they affected the subsequent 3D patch modeling. To improve the quality of the laneway model, we de-noised the original point cloud [34]. Figure 7a shows the original point cloud data, which consist of 72,268 points, of which there are 3477 noise points in total. Figure 7b is the point cloud after de-noising the points, with a total of 68,791 points.
In order to import the laneway model into Gazebo, the point cloud model of the laneway needs to be converted into a format recognized by Gazebo. In this paper, we uniformly adopted the ADE format. Kirkpatrick et al. [26] proposed a contour extraction method for 2D point sets in 1983 and Edelsbrunner et al. [25] extended this method to boundary surface extraction of 3D point sets. This method is called the alpha shape algorithm. In this paper, we use the alpha shape algorithm to extract the 3D boundary surface of the laneway point cloud model, see Algorithm 1.
Algorithm 1. alpha-shape
Input: 3D points set S ( N × 3 ) , Rolling circle radius α
Output: Triangular patch B F ( M × 3 )
1: Assign S to S 0 , S 0 = S
2: while  S is not empty do
3:    Arbitrarily choose a point P 1 in S
4:    Calculate the distances ( D i s ) of P 1 from other points in S , and the points set that satisfies D i s 2 × α is denoted as S 1
5:    Combine the points in S 1 in pairs to get the set P a i r
6:    while  P a i r is not empty do
7:       Arbitrarily select a pair of points P 2 , P 3 from P a i r and remove the pair of points P 1 , P 2 from the P a i r
8:       Find the centers O and O of a sphere of radius α passing through points P 1 , P 2 and P 3
9:       Traverse the point set S 1 , and find the distance sets D and D from other points to the center of the sphere O and O
10:      if  min ( D ) > α or min ( D ) > α then
11:          P 1 , P 2 and P 3 are boundary triangles, and the indices of P 1 , P 2 and P 3 are added to the B F set
12:       else  P 1 , P 2 and P 3 are not boundary triangles
13:       end if
14:    end while
15:    Remove P 1 from S
16: end while
17: Remove duplicate triangular patches from B F
We input the de-noised point cloud into the alpha shape algorithm, with α set to 5, and 53,168 triangular patches were outputted, as shown in Figure 8. The value of α has certain requirements. In this case, α was the maximum value of the point cloud interval. If α is too small, multiple shapes will be formed. If α is too large, the shape will be more convex and deviate from the shape of the laneway.
Then, the triangular patch model was converted into an ADE file using the 3D software. Figure 9 shows the three views of the laneway in the 3D software.

2.4. Simulation of Unmanned Driving System of the LHD vehicle in Gazebo

In this part, the motion control of the LHD vehicle is implemented in Gazebo through the ros_control Ros package, as shown in Figure 10. The/vehicle/L2_Joint_position_controller node controls the lift bucket by controlling the displacement of the L2_Link in the L1_Link. The/vehicle/Z2_Joint_position_controller node controls the flip bucket by controlling the displacement of the Z2_Link in the Z1_Link. The/vehicle/cmd_vel node controls the speed and articulation angular speed of the LHD vehicle by controlling the rotational speeds of the four wheels according to Equation (18). We use the Gazebo plug-in to add the motor model at the above link. The PID controls the motor to execute the movement of LHD vehicle according to the command issued. The/vehicle_teleop_keyboard is the keyboard control node, which sends motion commands to the LHD vehicle through the keyboard input. The keyboard control details are as follows:
  • Enter “w” from the keyboard to control the vehicle forward;
  • Enter “x” from the keyboard to control the vehicle back;
  • Enter “a” from the keyboard to control the vehicle to turn left;
  • Enter “d” from the keyboard to control the vehicle to turn right;
  • Enter “r” from the keyboard to control the vehicle to lift the bucket;
  • Enter “f” from the keyboard to control the vehicle to lower the bucket;
  • Enter “t” from the keyboard to control the vehicle to flip the bucket counterclockwise;
  • Enter “g” from the keyboard to control the vehicle to flip the bucket clockwise.
After the laneway model and the LHD model were imported into Gazebo, the above control nodes were ran. The LHD vehicle can be controlled to move in the laneway through the keyboard, as shown in Figure 11.

3. Results

In order to verify the reliability and effectiveness of the unmanned driving simulation system of the LHD vehicle, the following experiments were designed.

3.1. Validation of the Kinematic Model, Control Performance of the LHD Model

3.1.1. Experiment 1

In the Gazebo simulation platform, the speed and angular speed commands were inputted through the keyboard and the commands and the coordinates of the reference point of the LHD vehicle were simultaneously recorded. The speed and angular speed commands inputted from the keyboard were compared with the speed and angular speed executed by the simulation to verify the control performance of the LHD model in Gazebo. In addition, the recorded speed and angular speed commands were substituted into the kinematic model Equation (17) to verify the accuracy of the kinematic model.
As shown in Figure 12, the black dotted line is the speed command inputted from the keyboard and the range of the speed is 0–2 m/s. The red dotted line is the angular speed command inputted from the keyboard and the range of the angular speed is −0.1–0.1 rad/s. Since the real-time feedback data of the simulation platform are the coordinates of the reference point, the simulation execution speed was obtained by dividing the distance difference between the two frames by the time difference. Similarly, the angular speed of the simulation execution was obtained by dividing the difference in articulation radian between two frames by the time difference. The solid blue line in the figure is the speed of the simulation execution and the solid green line is the angular speed of the simulation execution. The speed and angular speed of the simulation were basically the same as the commands inputted from the keyboard. In order to quantitatively analyze the control performance of the LHD simulation platform, the root mean square error (RMSE) was used as the index. The higher the RMSE, the better the control performance.
RMSE = 1 n i = 1 n ( y ^ i y i ) 2
Here, y ^ i represents the speed or angular speed of the simulation execution in the i frame and y i represents the speed or angular speed of the keyboard inputted in the i frame. According to Equation (19), the RMSE of the simulation execution speed relative to the input command was 0.283 m/s and the RMSE of the angular speed relative to the input command was 0.010 rad/s.
In addition, with the same speed and angular speed commands in Figure 12, the trajectory obtained from the kinematic model was compared with the trajectory recorded by the simulation platform, as shown in Figure 13. The blue solid line in the figure is the trajectory of the reference point of the LHD vehicle recorded by the simulation platform and the red dotted line is the theoretical trajectory obtained by the kinematic model. The RMSE of the trajectory recorded by the simulation platform relative to the theoretical trajectory in the X direction is 1.412 m and the average percentage error in the Y direction is 0.727 m. These errors originate from the speed and angular speed control errors in Figure 12. It can be shown that the derived kinematics model of the LHD vehicle is very accurate at a low speed.

3.1.2. Experiment 2

The commands of lifting and flipping the bucket were inputted through the keyboard, the commands and the results of simulation execution were recorded, and the control performance of the shovel during the shovel loading process in Gazebo were verified.
As shown in Figure 14, the black dotted line in the figure is the command input from the keyboard to lift the bucket, that is, the displacement of the L2_Link in the L1_Link. The solid blue line is the result of the simulation platform execution and the displacement amount executed by the simulation platform relative to the RMSE of the input command is 0.025 m. The red dotted line in the figure is the command to input the bucket from the keyboard, that is, the displacement of the Z2_Link in the Z1_Link. The green solid line is the result of the simulation platform execution and the displacement amount executed by the simulation platform relative to the RMSE of the input command is 0.015 m.

3.2. Comparison between Simulation and Reality

Experiment 3

The execution results of the simulation platform and the actual system were compared by issuing the same speed and angular speed commands.
The LHD vehicle and the installation of the sensor in the actual system are shown in Figure 1 and the experiment was carried out in the real laneway, as shown in Figure 6a. The remote terminal sends commands to the intelligent controller on the LHD vehicle through 5G and then the intelligent controller sends commands to each actuator through CAN communication; that is the remote-control mode. The terminal commands were recorded at 10 Hz while in the remote-control mode. When simulating in Gazebo, the previously recorded commands were also sent to the simulation platform controller at a frequency of 10 Hz. As shown in Figure 15, the red solid line in the figure represents the speed command, the blue solid line represents the result of the simulation platform execution, and the green solid line represents the result of the real system execution. According to Equation (19), the execution speed of the simulation platform is 0.193 m/s relative to the RMSE of the issued command. The actual system execution speed is 0.360 m/s relative to the RMSE of the issued command and the execution speed of the simulation platform is 0.330 m/s relative to the actual system execution speed.
Likewise, Figure 16 is a comparison of the angular velocities from the simulation, the actual system, and the command. According to Equation (19), the angular speed of the simulation platform execution relative to the RMSE of the issued command is 0.069 rad/s. The RMSE of the angular speed executed by the actual system relative to the issued command is 0.123 rad/s and the RMSE of the angular speed executed by the simulation platform relative to the angular speed executed by the actual system is 0.106 rad/s.

3.3. SLAM Based on Simulation Platform

Experiment 4

SLAM was performed on the simulation platform and the map created by SLAM on the simulation platform and the map created by SLAM on the real system were compared.
SLAM is an important research direction for autonomous driving of underground unmanned LHD vehicles. Since both the downhole environment and the indoor environment are closed spaces, the indoor SLAM method can be used for the downhole SLAM method [35]. This paper adopts the cartographer mapping method proposed by Wolfgang [36] in 2016. The driving environment of the LHD vehicle is the laneway model established in the second chapter. Figure 17a is the map built using the real system. Using the method of real-time online mapping, the driver drives the forklift from the vicinity of point A to the vicinity of point E along the laneway. Figure 17b is the map created by the simulation. In the same way, real-time online mapping is used to control the LHD vehicle to drive from the vicinity of point A along the laneway to the vicinity of point E by inputting commands from the keyboard.
In Figure 18, there is a comparison of the map established by the simulation and the actual system and the main parameters measured. It can be clearly seen that: (1) The maps established by the simulation and the actual system are basically the same. Except for the BC segment, which differs by 6 m, the errors of other segments are all within 1.5 m. The RMSE of the map established by the simulation and the actual system is 2.843 m. (2) The map established by the simulation is closer to the measured value than the map established by the actual system. The RMSE of the map established by the simulation and the measured value is 0.917 m and the difference between the map established by the actual system and the measured value RMSE of 3.44 m. (3) The broken line graph in Figure 18 represents the simulation and real cumulative errors from the starting point to the destination of the LHD vehicle, respectively. It can be seen that the cumulative error tends to increase. The final cumulative errors of simulation and real are 3.79 and 7.40 m, respectively.

4. Discussion

Experiments 1 and 2 show that the control performance of the shovel simulation system is good and that the commands can be well executed during the driving process and the shovel loading process. In addition, Experiment 1 can also show that the derived kinematics model of the LHD vehicle is accurate at a low speed. However, whether the kinematics model can accurately describe the motion law of the LHD vehicle at a high speed is not yet studied in this paper.
Experiment 3 shows that the control performance of the simulated system is better than that of the actual system, the execution errors of the two systems are within an acceptable range, and the simulated system can be used to simulate the actual system. Why is the control performance of the simulated system better than the actual system? It is mainly explained by the following two aspects: (1) The actual system is more difficult to control than the simulation system and the simulation system is powered by a motor. The actual system is powered by hydraulic pressure and the power transmission system is far more complicated than the simulation system. (2) The command transmission of the actual system is more complicated than that of the simulation system. The actual system is a command issued by remote control, so the command transmission delay is much greater than that of the simulated system.
Experiment 4 shows that the simulation system is used to simulate the actual system, on which we can perform some algorithm tests. However, an abnormal phenomenon was found in the data of Experiment 4: the parameters of the map established by the simulation system, those of the map established by the actual system, and those of the measured values of the laneway were compared. The lengths of AB, CD, DE, and the width of the maps established by the two systems are relative to the measured values. Similar to the lengths of AB, CD, DE, and the width of the maps established by the two systems, we found that their difference was not large and was within the acceptable range, but the error of the length of the BC in the actual system from the measured value was 7.4 m. There are two reasons for this abnormal phenomenon: (1) The characteristics of the laneway in the BC section were not obvious and (2) The vibration of the LHD vehicle in the actual system increased the data of the noise collected by the IMU, while the movement of the LHD vehicle in the simulation system did not. The above two reasons lead to the “corridor effect” in the process of mapping the actual system. To sum up, it can be concluded that the effect of drawing on the simulation system is better than that when using the actual system.

5. Conclusions

In this paper, the models of the LHD vehicle and the laneway were mainly used to build a simulation system for unmanned driving of the LHD vehicle. The accuracy of the kinematic model of the LHD vehicle at a low speed was verified by experiments. Second, the principle of the interaction between the linkages during the driving and loading process of the LHD vehicle were analyzed and the Gazebo plug-in was written to support the closed-loop kinematic chain structure. An accurate 3D laneway model was established by combining 3D SLAM with alpha shape. Finally, the four experiments showed that the performance of the simulation system was good and can be used for the simulation of the actual system. In addition, the results of Experiment 4 show that the simulation system’s mapping results for the real world are better than the actual system. This can provide a new way of thinking for researchers in the direction of SLAM.

Author Contributions

Y.J. and P.P. participated in data analysis, participated in the design of the study and drafted the manuscript, carried out the statistical analyses; J.W. (Jiaheng Wang) and J.W. (Jiaxi Wu) collected field data; Y.L. provides a URDF file for the LHD model; L.W. conceived of the study, designed the study, coordinated the study, and helped draft the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (Grant No52104170), the National Key Research and Development Program of China under grant 2019YFC0605304, the Postgraduate Scientific Research Innovation Project of Hunan Province under grant CX20200243, and the Fundamental Research Funds for the Central Universities of Central South University (2020zzts194).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bołoz, Ł. Global Trends in the Development of Battery-Powered Underground Mining Machines. Multidiscip. Asp. Prod. Eng. 2021, 4, 178–189. [Google Scholar] [CrossRef]
  2. Bołoz, Ł.; Kozłowski, A.; Horak, W. Assessment of the Stability of Bev Lhd Loader. Manag. Syst. Prod. Eng. 2022, 30, 377–387. [Google Scholar] [CrossRef]
  3. Bołoz, Ł.; Biały, W. Automation and robotization of underground mining in Poland. Appl. Sci. 2020, 10, 7221. [Google Scholar] [CrossRef]
  4. Liang, C.J.; Kamat, V.R.; Menassa, C.C. Teaching robots to perform quasi-repetitive construction tasks through human demonstration. Autom. Constr. 2020, 120, 103370. [Google Scholar] [CrossRef]
  5. Paraszczak, J.; Gustafson, A.; Schunnesson, H. Technical and operational aspects of autonomous LHD application in metal mines. Int. J. Min. Reclam. Environ. 2015, 29, 391–403. [Google Scholar]
  6. Gustafson, A.; Lipsett, M.; Schunnesson, H.; Galar, D.; Kumar, U. Development of a Markov model for production performance optimisation. Application for semi-automatic and manual LHD machines in underground mines. Int. J. Min. Reclam. Environ. 2014, 28, 342–355. [Google Scholar] [CrossRef]
  7. Gustafson, A.; Schunnesson, H.; Kumar, U. Reliability analysis and comparison between automatic and manual load haul dump machines. Qual. Reliab. Eng. Int. 2015, 31, 523–531. [Google Scholar] [CrossRef]
  8. Scheding, S.; Dissanayake, G.; Nebot, E.M.; Durrant-Whyte, H. An experiment in autonomous navigation of an underground mining vehicle. IEEE Trans. Robot. Autom. 1999, 15, 85–95. [Google Scholar] [CrossRef] [Green Version]
  9. Rowduru, S.; Kumar, N.; Kumar, A. A critical review on automation of steering mechanism of load haul dump machine. Proc. Inst. Mech. Eng. Part I J. Syst. Control Eng. 2020, 234, 160–182. [Google Scholar] [CrossRef]
  10. Gao, L.; Jin, C.; Liu, Y.; Ma, F.; Feng, Z. Hybrid model-based analysis of underground articulated vehicles steering characteristics. Appl. Sci. 2019, 9, 5274. [Google Scholar] [CrossRef] [Green Version]
  11. Altafini, C. Path-tracking criterion for an LHD articulated vehicle. Int. J. Rob. Res. 1999, 18, 435–441. [Google Scholar] [CrossRef]
  12. Yu, H.; Zhao, C.; Li, S.; Wang, Z.; Zhang, Y. Pre-work for the birth of driver-less scraper (Lhd) in the underground mine: The path tracking control based on an lqr controller and algorithms comparison. Sensors 2021, 21, 7839. [Google Scholar] [CrossRef]
  13. Mäkelä, H. Overview of LHD navigation without artificial beacons. Rob. Auton. Syst. 2001, 36, 21–35. [Google Scholar] [CrossRef]
  14. Mascaró, M.; Parra-Tsunekawa, I.; Tampier, C.; Ruiz-Del-solar, J. Topological navigation and localization in tunnels—Application to autonomous load-haul-dump vehicles operating in underground mines. Appl. Sci. 2021, 11, 6547. [Google Scholar] [CrossRef]
  15. Goldfain, B.; Drews, P.; You, C.; Barulic, M.; Velev, O.; Tsiotras, P.; Rehg, J.M. AutoRally: An Open Platform for Aggressive Autonomous Driving. IEEE Control Syst. 2019, 39, 26–55. [Google Scholar] [CrossRef] [Green Version]
  16. Mashadi, B.; Majidi, M. Two-phase optimal path planning of autonomous ground vehicles using pseudo-spectral method. Proc. Inst. Mech. Eng. Part K J. Multi-Body Dyn. 2014, 228, 426–437. [Google Scholar] [CrossRef]
  17. Rivera, Z.B.; De Simone, M.C.; Guida, D. Unmanned ground vehicle modelling in Gazebo/ROS-based environments. Machines 2019, 7, 42. [Google Scholar] [CrossRef] [Green Version]
  18. Botelho, W.T.; Marietto, M.D.G.B.; Mendes, E.D.L.; De Sousa, D.R.; Pimentel, E.P.; Da Silva, V.L.; Dos Santos, T. Toward an interdisciplinary integration between multi-agents systems and multi-robots systems: A case study. Knowl. Eng. Rev. 2020, 35, e35. [Google Scholar] [CrossRef]
  19. Sharifi, M.; Chen, X.Q.; Pretty, C.; Clucas, D.; Cabon-Lunel, E. Modelling and simulation of a non-holonomic omnidirectional mobile robot for offline programming and system performance analysis. Simul. Model. Pract. Theory 2018, 87, 155–169. [Google Scholar] [CrossRef]
  20. Rubí, B.; Morcego, B.; Pérez, R. Deep reinforcement learning for quadrotor path following with adaptive velocity. Auton. Robots 2021, 45, 119–134. [Google Scholar] [CrossRef]
  21. He, D.; Yang, G.; Li, H.; Chan, S.; Cheng, Y.; Guizani, N. An Effective Countermeasure against UAV Swarm Attack. IEEE Netw. 2021, 35, 380–385. [Google Scholar] [CrossRef]
  22. Srichandan, A.; Dhingra, J.; Hota, M.K. An Improved Q-learning Approach with Kalman Filter for Self-balancing Robot Using OpenAI. J. Control Autom. Electr. Syst. 2021, 32, 1521–1530. [Google Scholar] [CrossRef]
  23. Saeedvand, S.; Mandala, H.; Baltes, J. Hierarchical deep reinforcement learning to drag heavy objects by adult-sized humanoid robot. Appl. Soft Comput. 2021, 110, 107601. [Google Scholar] [CrossRef]
  24. Farinelli, A.; Boscolo, N.; Zanotto, E.; Pagello, E. Advanced approaches for multi-robot coordination in logistic scenarios. Rob. Auton. Syst. 2017, 90, 34–44. [Google Scholar] [CrossRef]
  25. Iqbal, J.; Xu, R.; Sun, S.; Li, C. Simulation of an autonomous mobile robot for LiDAR-based in-field phenotyping and navigation. Robotics 2020, 9, 46. [Google Scholar] [CrossRef]
  26. Li, Y.; Fang, M.; Feng, M.L.; Frimpong, S. Three dimensional modeling of the working linkage of load-haul-dump loader. Int. J. Adv. Manuf. Technol. 2007, 32, 856–862. [Google Scholar] [CrossRef]
  27. Cremer, S.; Saadatzi, M.N.; Wijayasinghe, I.B.; Das, S.K.; Saadatzi, M.H.; Popa, D.O. SkinSim: A Design and Simulation Tool for Robot Skin with Closed-Loop pHRI Controllers. IEEE Trans. Autom. Sci. Eng. 2021, 18, 1302–1314. [Google Scholar] [CrossRef]
  28. Edelsbrunner, H.; Miicke, E.P. Three-dimensional alpha shapes. In Proceedings of the 1992 Workshop on Volume Visualization, Boston, MA, USA, 19–20 October 1992; Volume 13, pp. 75–82. [Google Scholar]
  29. Kirkpatrick, D.G.; Seidel, R. On the Shape of a Set of Points in the Plane. IEEE Trans. Inf. Theory 1983, 29, 551–559. [Google Scholar]
  30. Corke, P.I.; Ridley, P. Steering kinematics for a center-articulated mobile robot. IEEE Trans. Robot. Autom. 2001, 17, 215–218. [Google Scholar] [CrossRef] [Green Version]
  31. Ridley, P.; Corke, P. Load haul dump vehicle kinematics and control. J. Dyn. Syst. Meas. Control Trans. ASME 2003, 125, 54–59. [Google Scholar] [CrossRef]
  32. Gondokaryono, R.A.; Agrawal, A.; Munawar, A.; Nycz, C.J.; Fischer, G.S. An approach to modeling closed-loop kinematic chain mechanisms, applied to simulations of the da Vinci surgical system. Acta Polytech. Hung. 2019, 16, 29–48. [Google Scholar]
  33. Li, K.; Li, M.; Hanebeck, U.D. Towards High-Performance Solid-State-LiDAR-Inertial Odometry and Mapping. IEEE Robot. Autom. Lett. 2021, 6, 5167–5174. [Google Scholar] [CrossRef]
  34. Rusu, R.B.; Marton, Z.C.; Blodow, N.; Dolha, M.; Beetz, M. Towards 3D Point cloud based object maps for household environments. Rob. Auton. Syst. 2008, 56, 927–941. [Google Scholar] [CrossRef]
  35. Roberts, J.M.; Duff, E.S.; Corke, P.I. Reactive navigation and opportunistic localization for autonomous underground mining vehicles. Inf. Sci. 2002, 145, 127–146. [Google Scholar] [CrossRef]
  36. Hess, W.; Kohler, D.; Rapp, H.; Andor, D. Real-time loop closure in 2D LIDAR SLAM. In Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden, 16–21 May 2016; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2016; Volume 2016, pp. 1271–1278. [Google Scholar]
Figure 1. The LHD vehicle’s kinematic geometry.
Figure 1. The LHD vehicle’s kinematic geometry.
Sustainability 14 15186 g001
Figure 2. Physical links of the LHD model. Notes: base_footprint is the front body; CH_Link is the rear body; Z3_Link and Z4_Link are the linkages between the flipping cylinder and the bucket; CB_Link is the big arm; CD_Link is the bucket.
Figure 2. Physical links of the LHD model. Notes: base_footprint is the front body; CH_Link is the rear body; Z3_Link and Z4_Link are the linkages between the flipping cylinder and the bucket; CB_Link is the big arm; CD_Link is the bucket.
Sustainability 14 15186 g002
Figure 3. The relationship of physical links. Notes: base_link is the virtual link; LFW_Link, RFW_Link, LBW_Link, and RBW_Link are the left front wheel, the right front wheel, the left rear wheel, and the right rear wheel, respectively; Rcamera_link and Fcamera_link are the front camera and the rear camera, respectively; Blidar_link and Flidar_link are the front lidar and the rear lidar, respectively; Z1_Link and Z2_Link are flip cylinders; L1_Link and L2_Link are the lift cylinders; C1_Link, C2_Link, C3_Link, and C4_Link are the turning cylinders; imu_link is IMU.
Figure 3. The relationship of physical links. Notes: base_link is the virtual link; LFW_Link, RFW_Link, LBW_Link, and RBW_Link are the left front wheel, the right front wheel, the left rear wheel, and the right rear wheel, respectively; Rcamera_link and Fcamera_link are the front camera and the rear camera, respectively; Blidar_link and Flidar_link are the front lidar and the rear lidar, respectively; Z1_Link and Z2_Link are flip cylinders; L1_Link and L2_Link are the lift cylinders; C1_Link, C2_Link, C3_Link, and C4_Link are the turning cylinders; imu_link is IMU.
Sustainability 14 15186 g003
Figure 4. Schematic diagram of the movement of the relevant links when the LHD vehicle is shoveled and turned. (a) Schematic diagram of shovel loading; (b) Schematic diagram of turning.
Figure 4. Schematic diagram of the movement of the relevant links when the LHD vehicle is shoveled and turned. (a) Schematic diagram of shovel loading; (b) Schematic diagram of turning.
Sustainability 14 15186 g004
Figure 5. The LHD Simulated Model.
Figure 5. The LHD Simulated Model.
Sustainability 14 15186 g005
Figure 6. Modeling and simulation of the underground laneway. (a) The real laneway environment underground; (b) Flowchart for laneway modeling.
Figure 6. Modeling and simulation of the underground laneway. (a) The real laneway environment underground; (b) Flowchart for laneway modeling.
Sustainability 14 15186 g006
Figure 7. Point cloud noise reduction. (a) Raw point cloud; (b) De-noised point cloud.
Figure 7. Point cloud noise reduction. (a) Raw point cloud; (b) De-noised point cloud.
Sustainability 14 15186 g007
Figure 8. Triangulate the point cloud using alpha shape.
Figure 8. Triangulate the point cloud using alpha shape.
Sustainability 14 15186 g008
Figure 9. The laneway model view. (a) top view; (b) front view; (c) right view.
Figure 9. The laneway model view. (a) top view; (b) front view; (c) right view.
Sustainability 14 15186 g009
Figure 10. Node graph for the LHD vehicle’s motion control.
Figure 10. Node graph for the LHD vehicle’s motion control.
Sustainability 14 15186 g010
Figure 11. Simulation of the unmanned driving system of the LHD vehicle in Gazebo.
Figure 11. Simulation of the unmanned driving system of the LHD vehicle in Gazebo.
Sustainability 14 15186 g011
Figure 12. Control performance graph of speed and angular speed.
Figure 12. Control performance graph of speed and angular speed.
Sustainability 14 15186 g012
Figure 13. Under the same input command, the comparison between the trajectory obtained by the kinematic model and the trajectory recorded by the simulation platform.
Figure 13. Under the same input command, the comparison between the trajectory obtained by the kinematic model and the trajectory recorded by the simulation platform.
Sustainability 14 15186 g013
Figure 14. Control performance graph of lift and flip buckets.
Figure 14. Control performance graph of lift and flip buckets.
Sustainability 14 15186 g014
Figure 15. Comparison chart of speed from the simulation, real system, and command.
Figure 15. Comparison chart of speed from the simulation, real system, and command.
Sustainability 14 15186 g015
Figure 16. Comparison chart of angular speed from the simulation, real system, and command.
Figure 16. Comparison chart of angular speed from the simulation, real system, and command.
Sustainability 14 15186 g016
Figure 17. Comparison of maps built with SLAM from simulation and real systems. (a) Maps built on the real system; (b) Maps built on the simulation.
Figure 17. Comparison of maps built with SLAM from simulation and real systems. (a) Maps built on the real system; (b) Maps built on the simulation.
Sustainability 14 15186 g017
Figure 18. The laneway parameters from measurements, simulated systems, and real systems.
Figure 18. The laneway parameters from measurements, simulated systems, and real systems.
Sustainability 14 15186 g018
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Jiang, Y.; Peng, P.; Wang, L.; Wang, J.; Liu, Y.; Wu, J. Modeling and Simulation of Unmanned Driving System for Load Haul Dump Vehicles in Underground Mines. Sustainability 2022, 14, 15186. https://0-doi-org.brum.beds.ac.uk/10.3390/su142215186

AMA Style

Jiang Y, Peng P, Wang L, Wang J, Liu Y, Wu J. Modeling and Simulation of Unmanned Driving System for Load Haul Dump Vehicles in Underground Mines. Sustainability. 2022; 14(22):15186. https://0-doi-org.brum.beds.ac.uk/10.3390/su142215186

Chicago/Turabian Style

Jiang, Yuanjian, Pingan Peng, Liguan Wang, Jiaheng Wang, Yongchun Liu, and Jiaxi Wu. 2022. "Modeling and Simulation of Unmanned Driving System for Load Haul Dump Vehicles in Underground Mines" Sustainability 14, no. 22: 15186. https://0-doi-org.brum.beds.ac.uk/10.3390/su142215186

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop