Next Article in Journal
Seed Pre-Soaking with Melatonin Improves Wheat Yield by Delaying Leaf Senescence and Promoting Root Development
Next Article in Special Issue
Decision Support Tool for Operational Planning of Field Operations
Previous Article in Journal
Silica Production across Candidate Lignocellulosic Biorefinery Feedstocks
Previous Article in Special Issue
Price Forecasting and Span Commercialization Opportunities for Mexican Agricultural Products
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Metric Map Generation for Autonomous Field Operations

by
Kun Zhou
1,2,*,
Allan Leck Jensen
2,
Dionysis Bochtis
2,3,
Michael Nørremark
2,
Dimitrios Kateris
3 and
Claus Grøn Sørensen
2,*
1
Research & Advanced Engineering, Global Harvesting, AGCO A/S, Dronningborg Alle 2, 8930 Randers, Denmark
2
Department of Engineering, Aarhus University, Blichers Allé 20, P.O. Box 50, 8830 Tjele, Denmark
3
Institute for Bio-Economy and Agri-Technology (IBO), Centre for Research & Technology Hellas—(CERTH), 6th km Charilaou-Thermi Rd, 57001 Thessaloniki, Greece
*
Authors to whom correspondence should be addressed.
Submission received: 19 October 2019 / Revised: 2 January 2020 / Accepted: 6 January 2020 / Published: 7 January 2020
(This article belongs to the Special Issue Agricultural Route Planning and Feasibility)

Abstract

:
Advanced systems for manned and/or agricultural vehicles—such as systems for auto-steering, navigation-adding, and autonomous route planning—require new capabilities in terms of the internal representation for the autonomous system of the working space; that is, the generation of a metric map that provides by numerical parameters any operation-related entity of the working space. In this paper, a real-time approach was developed for the generation of the field metric map, based on a row generation method (polygons-based geometry). The approach can deal with fields with or without in-field obstacles, where the generated field-work tracks can be either straight or curved. The functionality of the approach was demonstrated on 12 fields with different number of obstacles ranging from one to six. The test results showed that the computational times were in the range of 0.26–24.51 s. The presented tool brings a number of advancements on the process of generating a metric map for arable farming field operations, including the real-time generation feature, the potential to deal with multiple-obstacle areas, and the reduction in the overlapped area.

1. Introduction

Agriculture faces a range of social and environmental challenges, such as the growing demand for high-quality food products, climate change, and market globalization. Farmers are forced to reduce production cost while maximizing the quality of products in order to compete in the globalized market [1]. Machinery investment, maintenance, and operational usage are key parts of the production costs. In order to enhance machinery productivity and operational efficiency, and consequently to reduce production costs, increasing efforts are being contributed to the development of advanced operations management systems using advanced information technologies, automation, sensing systems, and actuating systems [2,3,4,5].
As part of these aforementioned efforts, a significant amount of research has been dedicated to the development of advanced algorithms or methods for automating operations optimization in arable farming. This has included various approaches for the improvement of the field efficiency of semi-automated operations (navigation-adding systems) or fully autonomous (field robots) operations, and these approaches include route planning and field area coverage [6,7,8,9,10,11,12,13,14,15,16,17,18]. However, the transition of field operations from manual operated operations to fully automated operations requires new functionalities of the developed operations optimisation systems.
To this direction, a significant amount of research has been dedicated to the development of advanced algorithms or methods for automating operations optimization in arable farming. This has included various approaches for the improvement of the efficiency of field automated (navigation-adding systems) or autonomous (field robots) operations, such as route planning and field area coverage approaches [6,7,8,9,10,11,12,13,14,15,16,17,18]. However, the modification of the processes from conventional to fully automated operation requires new functionalities of the developing systems.
The execution of autonomous operations requires a “world representation”, that is a geometrical representation of working space for the autonomous system. This usually includes the use or the generation of a metric map that provides by numerical parameters the representation of any operation-related entity of the working space. In the general mobile robotics case, this metric map could be either a Cartesian (geometrical) map or a grid-based map. However, in agricultural operations, due to the constrained vehicle traversal of the field (i.e., moving on pre-defined field-work tracks), all of the approaches regard the generation of a geometrical map. A number of methods have been introduced for the generation of geometrical representation of either simple convex or complex concave fields. For example, Palmer et al. (2003) generated predefined field-work tracks aiming to reduce the amount of overlapped and missed area [19]. Taïx et al. (2006) proposed algorithms to generate straight field-work tracks for field coverage both in the cases of convex or non-convex fields without obstacles [20]. Algorithms for the generation of field representations for complex fields have been developed by Oksanen and Visala (2007), in which, firstly, complex fields were divided into simple trapezoid fields, then straight field-work tracks were generated, based on a calculated driving direction derived from the function of working width and turning time [21]. Hameed et al. (2010) presented a mathematically descripted method for the generation of field geometrical representations in real time for fields with or without obstacles using straight or curved field tracks [22]. Spekken et al. (2016) presented a method to generate patterns of fieldwork tracks in the form of curved polylines on sloping land to assess their susceptibility to water erosion [12]. Hameed et al. (2016) presented an approach for a 3D coverage map generation, where the 2D coverage map is projected through field terrain [23]. The selected test fields showed savings of skipped and overlapped areas in the range of 2%–14%. However, all methods have some limitations in terms of completeness. Tracks generated in the various methods only intersect with the inner boundary of the field or the outer boundary of obstacles, as shown Figure 1a. It can be seen that following these generated field-work tracks by agricultural vehicles will lead to uncovered areas (yellow colored area). Therefore, in order to cover the entire field, these tracks have to be extended by some distance as shown in Figure 1b. The process of tracks extension becomes complicated when a field comprises multiple obstacles.
To this end, in this paper a new algorithmic method for the generation of a metric map representing an agricultural field using headland field work pattern is presented. In this method, a row generation-based approach (polygons-based geometry) is implemented to eliminate the uncovered areas as illustrated in Figure 1a. The generated fieldwork tracks can be either straight or curved field-work tracks for any complexity level of fields in terms of shape and number of in-field obstacles. It should be noted that the presented approach aims to provide partial improvements in the problem of metric map generation for field autonomous operation and not yet a complete solution. This is due to various limitations of the approach which are presented in the Discussion Section.

2. Methods

In this section, firstly, the applied geometric primitives are explained and defined in Section 2.1. Next, various geometric operators used for manipulation of geometric primitives are introduced in Section 2.2. Lastly, the procedures of generating field geometrical representation are presented in details in Section 2.3.

2.1. Geometric Primitives

Polyline. A polyline, l , is an ordered path composed of a collection of contiguous line segments l = l x 1 x 2 , l x 2 x 3 , , l x n 1 x n . A line segment is a special case of a polyline with n = 2 .
Polygon. A polygon, p , is defined by a collection of rings, p = r 1 , r 2 r n ,   n 1 , where a ring, r , is defined by a collection of contiguous ordered line segments, r = l x 1 x 2 , l x 2 x 3 l x n x 1 , such that the start and end points are the same point, as depicted in Figure 2a.
A polygon has one outer ring r 1 and zero or multiple inner rings { r 2 , , r n } . The outer ring r 1 is oriented clockwise while an inner ring r i ,   i { 2 , , n } is oriented counter-clockwise (see Figure 2b). Following this orientation, the area to the right of the outer ring and the inner rings defines the interior (shaded part in Figure 2) of the polygon. Similarly, the area to the left of the rings is the exterior of the polygon. In our study, the field boundary is equivalent to the outer ring, the obstacle boundary is equivalent to an inner ring, and the field body F b (the operational area) is equivalent to the interior polygon area.
Envelope. An envelope, e , is a bounding rectangle that encloses a geometry g   { l ,   r ,   p } . A given geometry g can have multiple bounding rectangles with different orientation angle. The minimum bounding rectangle e m i n (as shown in Figure 3) has the smallest area among all the bounding rectangles.

2.2. Geometric Operators

Intersection ( ( A , B ) ). The intersection operator is used to find the overlapped area g between two geometries Α and Β . The geometries can be line segments, polylines, rings or polygons. If g is the intersection between Α and Β it satisfies that g A g B . Intersection examples are illustrated in Table 1 where the green marked geometry corresponds to the intersection between two examples of geometries Α and B .
Subtraction ( Δ   ( A ,   B ) ). The subtraction operator Δ determines a geometry g , which is the difference between the two input geometries A and B . The subtracted geometry g satisfies the condition that g A g B and. Examples are given in Table 1. Note, that subtraction does not obey the commutative law ( Δ   ( A ,   B ) Δ   ( B , A ) ).
Offset ( ± d g ). The offset operator ± d g creates a geometry that is parallel to the input geometry g   { l ,   r ,   p } at a specified distance d . The distance can be either positive ( + ) or negative ( ) . Examples of offset for a polygon, polyline and line segment are presented in Table 2.
Buffer ( Π d l ). The buffer operator Π creates a polygon around the input line l , which may be a line segment or a polyline. First, two parallel lines to both sides of l at a specified distance d are generated with the offset operator + d l and d l , and then, these two lines are joined in the ends to compose the buffer polygon p b u f around l . In the example in Figure 4, the black line is the input line   l and the green polygon is a buffer polygon.
Projection ( ( m , l ) ). The projection operator, , projects a point m to a line or polyline l and determines the projected point m on l such that the line l m m has the shortest distance to l . Figure 5a. illustrates how the points m 1 , m 2 , m 3 and m 4 are projected on the polyline l = l x 1 x 2 , l x 2 x 3 . Note, that m 2 projects to two points on l , m 2 and m 2 , since m 2 is equidistant to the line segments l x 1 x 2 and l x 2 x 3 in Figure 5a. The projection point m can be either interior or exterior of l , as illustrated in Figure 5a, where the projection points m 1 , m 2 , m 2 and m 3 are interior to l , while m 4 is exterior.
Point union ( ( { m } ) ). The point union operator takes an ordered set of points { m } and generates a polyline consisting of line segments with end points in { m } . In the context of this paper, the point union operator is always used along with the projection operator to create a line segment or a polyline that links all the projection points and points of the original line that lie in between these projection points. This is illustrated in Figure 5b, where the point union operator is used to create a new polyline l = ( { m } ) , where m = { m 1 , m 2 , x 2 , m 2 , m 3 , x 3 , m 4 } .
Boolean intersect ( &   ( A ,   B ) ). The boolean intersect operator & is used to check if two geometries A , B intersect or not, i.e., if they share at least one point.

2.3. Metric Map Generaiton

In this section, the methods for generation of the geometrical representation of a field by using the aforementioned geometric primitives and operators are introduced.

2.3.1. Inputs

The input set required for the generation of the field metric map includes:
  • The boundary of the field area and the boundaries of the in-field obstacles, which are represented by a polygon, p field .
  • The number of headland passes ( η ) for the main field and each obstacle.
  • The line ( l A B ), which is used as A B reference line for generation of the parallel field-work tracks. l A B can be either a straight-line segment or a polyline.
  • The operating width ( w ). This is the effective operating width of the implement.

2.3.2. Metric Map Entities

The representation involves the generation of the following geometric entities:
Headland passes: a headland pass is a peripheral path internally around the field boundary or externally of an obstacle. The headland area consists of the several headland passes and provides the required space for the machine turnings. The remaining field area excluding the (field and obstacle/s) headland areas and obstacle/s area/s, is called the field body area.
Field-work tracks: In order to cover the entire field body area, a set of parallel tracks has to be generated as the guidance lines for the agricultural machine. These field-work tracks can be represented either as straight-line segments or as curved polylines.
Rows: each row area is the area processed by an implement while driving along a track. The width of each row equals the effective implement width of the machine, w .
The overlapped area is a double covered (processed) area, which occurs at headland turnings or at the first and last row when they are doubled by the headland area.
In the following, the specific methods of the generation of these entities are described.

2.3.3. Generation of Headland Passes and Headland Areas

A headland area must be generated for the field as well as for each of its obstacles. Each headland area consists of η + 2 rings, where η is the number of headland passes, namely the field (or obstacle) boundary, the η headland passes, and the headland boundary to the main field area (shown in Figure 6 with black, blue, and red rings, respectively). Let r { r f , r 1 ,   ,   r θ } denote the boundary of the field and the boundaries of the θ obstacles. Let H r = { h 1 , , h η } denote the headland passes (blue rings in Figure 6). The first headland pass is obtained by offsetting r at distance w / 2 : h 1 =   + w / 2 r . The subsequent headland passes are generated recursively by offsetting at distance w from the previous headland pass: h i =   + w h i 1 ,   i = 2 , , η . Finally, the headland boundary ring (red rings in Figure 6) is created at a distance w / 2 from the last headland pass h η : b =   + w / 2 h η . In this way, the headland area of a field or obstacle contains the rings: { r ,   h 1 , h 2 , , h η ,   b } . For the field we denote the outer and inner boundaries r f and b f , respectively. The field body area F b can be obtained by using the subtraction operation F b = Δ ( b f , i = 1 θ b i ) , which is the enclosed area by b f excluding the total area enclosed by the obstacle inner boundary b i , i { 1 , , θ } .

2.3.4. Tracks and Rows Generation

In the following, the method for generating straight and curved tracks is described.
Straight field-work tracks
As a first step, in order to restrict all generated tracks inside the operational area, a bounding envelope e (the green rectangle in the Figure 7a) of the field’s headland boundary ring, b f , is generated with one edge l of the envelope parallel to the driving direction l A B . The edge l is selected as a reference line for generating tracks. The number of field-work tracks for a complete coverage of area e . is given by τ   = | l | / w where ⌈⌉ is the ceil function and | l | is the length of the edge l of e that is perpendicular to l . A set T = { t 1 , t 2 , , t τ } of initial line segments, each with two intersections with the bounding envelope e , is generated sequentially by offsetting the reference line l and by implanting using the offset operator: t i =   d =   w / 2 + ( i 1 ) · w l ,   i = 1 ,   2 τ (the black lines with dotted end points in Figure 7b).
The specific steps for the generation of the field-work tracks and the corresponding rows, includes:
  • Firstly, each initial track t i is used to create a buffer polygon p buf using the buffer operator Π w / 2   t i (Figure 8a). Then, the intersection operator is used to find the intersection area between the buffer polygon p buf and the inner field boundary b f disregarding obstacles: p int =   ( p buf , b f ) (Figure 8b).
  • Next, the boolean intersect operator & is applied to check whether the p int intersects with the obstacles. Following this, there are three potential cases, as illustrated in Figure 8c: Case 1: if p int is not intersected with any obstacle, then p int remains unchanged; Case 2: if p int only partially intersects with obstacles, then the subtraction operator Δ is employed to obtain the subtracted area; and Case 3: if p int crosses through an obstacle, then the subtraction operator Δ divides the polygon p int into sub-polygons. Other cases such as a p int partially intersects one obstacle and crosses through another obstacle are considered as the case of the combination of basic cases 2 and 3.
  • After the subtraction operation has been performed, each p fin area is enclosed by a ring with multiple points denoted as a set { m } (red points in Figure 8c). To obtain the final track, t fin , first, points in the set { m } are projected to the initial track t by the projection operator to acquire the projection points set { m } . Afterwards, the final track t fin (black dotted lines in Figure 9a) is created using the union operator ( { m } ) . In addition, the row R fin of the final track t fin (green area in Figure 9b) is generated by employing the buffer operator Π w / 2 t fin .
A field representation derived from applying these three steps on each row is illustrated in Figure 9c.
The pseudo-code of the process is shown in Algorithm 1.
Algorithm 1. Pseudo-code for the generation of straight tracks and corresponding rows.
For each initial track t ϵ   { t 1 , t 2 t τ } do
p b u f   Π w / 2 t   # Create a buffer around a initial track t
p i n t     ( p b u f , b f ) # Obtain the intersection p i n t between p b u f and field inner boundary area b f
If   & ( p i n t ,   b i = { 1 , 2 , , θ } ) == false
   p f i n p i n t ;
Else
   p f i n Δ   ( p i n t ,   b i = { 1 , 2 , , θ } ) ; # Find the subtracted area between p i n t and inner boundary b i = { 1 , 2 , , θ } of obstacle r i .
End
For each p f i n do
  Get a set of projection points to t , {m′} ← ( m , t ) , m is the set of points that constitute p f i n ;
  Final track t f i n ( { m } ) ;
   Row of final track R f i n Π w / 2 t f i n ;
End
End
Curved field-work tracks
The procedure to generate a geometrical map with curved tracks is similar to the procedure for straight tracks explained above. The differences stem from the fact that the reference line l A B in latter case is a polyline. In the following, the procedure for generation of curved tracks is presented with reference to Figure 10.
To ensure that the operational area is fully covered with parallel, curved tracks, the minimum-bounding envelope e m i n of the outer field border, r f , is used (Figure 10a). The reference line l A B is laid out along the inner field border, b f , such that the orientation of the line follows the clockwise ordering around the field inner boundary (Figure 10b). Then, l A B is extended to intersect with e m i n , resulting in the extended reference line, l A B (Figure 10c). Next, the first of a sequence of initial tracks T = { t 1 , t 2 , , t τ } covering e m i n is generated. The first track t 1 is made up as an offset of l A B of a width of w / 2 : t 1 =   + w / 2 l A B (Figure 10d). Note, that since l A B , like as l A B , follows the clockwise direction it is only required to use offset to the right ( + for distance parameter) to make offset inwardly to operational area. The next steps are analogous to the generation of straight tracks: Generation of buffer polygon p b u f for each track (Figure 10e); subtraction of area outside the inner field boarder and obstacle borders to obtain first p i n t and then p f i n (Figure 10f); projection of points on p f i n to t 1 (Figure 10g) to determine the final first track, t 1 and the corresponding row R 1 (Figure 10h). Having completed the first track, the subsequent initial tracks can be generated recursively from the previous final track: t i =   + w t i 1 ,   i = 2 , , τ . Then the initial track t i can be finalized into t i until the final tracks cover the entire operational area of the field (Figure 10i). The pseudo-code for generation of curve tracks with corresponding rows is give in Algorithm 2.
Algorithm 2. Pseudo-code for generation of curved tracks with corresponding rows.
  While until no track intersects with e m i n
   If i = = 1
      l A B Extend l A B to intersect with e m i n ;
     t 1 = w / 2 l A B ;
     p b u f Π w / 2   t 1   # Create a buffer around t 1 ;
    Else
      t i = Extend t i 1 to intersect with e m i n ;
      p b u f Π w t i   # Create a buffer around t i ;
   End
    p i n t p b u f   b f # Obtain the intersection p i n t between p b u f and field inner boundary area b f ;
   If  & ( p i n t ,   b i = { 1 , 2 , , θ } ) == false
      p f i n p i n t ;
   Else
      p f i n Δ   ( p i n t ,   b i = { 1 , 2 , , θ } ) ; # Find the subtracted area between p i n t and inner boundary b i = { 1 , 2 , , θ } of obstacle r i .
   End
   Get set of projection points {m′} ←   ( m , t i ) , m is the set of points that constitute p f i n ;
    Final track t 1 ( { m } ) ;
   Row of final track R f i n Π w / 2 t 1 ;
      i = i + 1 ;
  End
It has to be note that the reference line l A B is not necessarily to be edge(s) of field boundary, it can be an edge in any angle for straight tracks generations, or any number of connected edges for curved tracks generations—in that situation, then the reference line l A B need to offset to left and right sides by using the offset operator ± d g , until the tracks cover the entire operational area of the field based on the above-described procedures.

2.3.5. Overlapped Area Quantification

Overlapped area parts, o , produced by each row R can be computed by using the subtraction operator Δ   ( R ,   F b ) , as illustrated in Figure 11. The total overlapped area ( Ο ) can be quantified as summation of each individual overlapped area of each row by O = i = 1 τ | o i | .

3. Implementation and Results

The algorithms for generation of geometrical field representations described above were implemented using the JAVA programming language (Oracle Corporation) and executed on a standard computer with a CPU of 3.2 GHz processor and a 4 GB RAM. To demonstrate the functionality of the process, 12 fields with different number of obstacles ranging, from one to six, were selected, representing a range of complexity levels of field shapes. The field shape files were provided by the GIS database from The Ministry of Environment and Food of Denmark. Three types of working width ( w = 2 m, 4 m, 6 m) were used. The driving direction for each field is represented by the red marked line suggested by technical staff, as shown in the Table 3. The results of average computation time of the method (as an average of 1000 runs per case) are listed in Table 3.
In addition, two scenario studies were carried out to investigate the effect of using different field-work tracks references, directions, and operating widths on the generated metric map. Figure 12 presents the two selected fields (field 2 and field 10 from Table 3) as examples that include both straight and curved field-work tracks.
In this scenario, field 10 was selected for test, and four straight reference lines for the generation of straight tracks were used as shown in Figure 13. Field geometrical representations for each direction with 6 m working width are illustrated in Table 4. The tested results are given in Table 4, in which we can see that the driving direction not only determines the number of generated tracks but also determines the size of the overlapped area when the working width is the same. In terms of number of tracks, the maximum difference is up to 56 when comparing driving direction d2 with d4 using working width w = 4 m, while in terms of overlapped area, it can be found that larger working widths lead to larger overlapped areas, which corresponds with conclusions derived by Luck et al. (2010). Additionally, it can be seen that less tracks do not produce less overlapped area, for instance comparing d4 with d1 when working width was 4 m [24].
In this scenario, two curved reference lines and two straight reference lines were used for the generation of tracks for field 2 and field geometrical representations for each direction with 6 m working width are illustrated in Figure 14, and these four reference lines are the possible choices a machine operator will make for field operations. From the results presented in Table 5, it can be seen that curved tracks resulted in less overlapped area when using the same working width. Among all these setups, the setup that using driving direction d1 and working width w = 6 m might be the most favorable as it yields the fewest number of tracks—implying that less turns are required to cover the entire field, which, consequently might mean less non-working time.

4. Discussion

From the previous two scenario studies, we can see that the presented tool has the potential capability to be used as a decision support system to find, for example, the driving direction that yields the least overlaps (i.e., spraying), or the least number of turns, or can even be used as an input for high-level planning such as path planning [6,7], route planning [8,9,10,11,12,13], and field coverage planning [14,15,16,17,18].
Based on the test results in Table 3, the computational times of the presented method were in the range 0.26–24.51 s for various field shapes, and the area ranged between 10.27 and 74.58 ha. Compared with fields with straight tracks, the map generation for fields with curved tracks requires higher computational times. The average computational time for fields with straight tracks was 1.16 s, while for curved tracks it was 7.69 s. The main reason for higher computational times in the case of curved tracks is that each time a subsequent curved track is constructed, a new curved reference line has to be created, that is, the predecessor curved track. This repetitive process consumes a large percentage of the overall computational time.
The low computational times of the proposed method—in the level of seconds—provides the potential for real-time implementation in agricultural machine navigation systems, precision application tools (e.g., automatic boom section control for spraying), autonomous robots. The importance of a real-time map generation is derived from a number of reasons:
  • Not all information about field shapes is often available, so the operator has to drive around the field and obstacles boundaries to acquire the path coordinates, and so the map generation process has to take place on-site.
  • The field metric map should be generated based on the effective working width instead of the specified working width which in many cases the operator must adjust to field conditions.
  • Factors also such as soil condition in terms of moisture content also affects field shapes and thus affecting the field representation scheme. That might be the case, when, for example, a water area inside the field resulting from rain constitutes an operational obstacle for the proposed method and would require a new field representation to be generated in real-time, on site, for the remainder of the field operation.
The presented tool brings a number of advancements to the process of generating a metric map for arable farming field operations. These advancements include the real-time generation feature, the potential to deal with multiple-obstacle areas, and the reduction in the overlapped area. However, for considering this approach as “complete”, a number of limitations still hold. These limitations include:
  • Regarding infield obstacles, the proposed method does not handle cases such as two obstacles in close proximity. These types of obstacles, from the operational point of view, should be considered as one obstacle. Furthermore, cases of small obstacles (e.g., trees, electricity pylons, etc.) that cause a local deviation from the designed track are not taken into account. The categorization of the obstacles depending on the driving direction, working width, the shape of field, size and location of obstacle [18] is an important step in the map generation since it affects the accuracy and feasibility of the generated field representation scheme.
  • In the case of curved tracks, each track consists of sequentially connected line segments. There are cases where it is not feasible for an agricultural machine to perform a sharp turn between two line segments due to operational limitations on the maximum turning curvature. Therefore, there is the need for the implementation of curved polyline smoothing algorithms to generate an easier steerable path for agricultural machines [12].
  • As part of the tool, the machine operator has to set the value of the number of headland passes manually for generation of the required headland space. It might be difficult for the user to determine an appropriate value due to the fact that the headland space depends on a number of factors such as field shapes, field condition, machine’s kinematic features and so on. Therefore, an algorithm or model should be developed for this tool to improve the reliability of the field representation.
  • This tool needs further elaboration so that the user can interactively divide the field into subfields, where each subfield can have its own driving direction.

5. Conclusions

In this paper, a new approach for a metric map generation for autonomous field operations was developed. The generated map consists of either straight or curved field-work tracks for any complexity level of fields in terms of the shape and number of in-field obstacles. According to the test results on 12 selected fields with different numbers of obstacles and diverse shapes, the computational times were in the range of 0.26–24.51 s demonstrating that it is feasible for real-time implementation.
The proposed approach can be deployed for navigation-aiding system for agricultural machinery or as part of the high-level control of autonomous field machines. However, this tool still needs further elaboration in terms of extending with the capability of supporting field subdivision, automatic process for obstacles categorization, automatic determination of headland space, and smooth curve tracks generation.

Author Contributions

Conceptualization, K.Z., D.B. and C.G.S.; Data curation, K.Z. and A.L.J.; Formal analysis, A.L.J. and C.G.S.; Methodology, K.Z. and D.B.; Resources, K.Z.; Software, K.Z. and D.K.; Supervision, D.B. and C.G.S.; Validation, K.Z., A.L.J., M.N. and D.K.; Visualization, K.Z., M.N. and D.K.; Writing—original draft, K.Z.; Writing—review & editing, A.L.J., D.B., M.N., D.K. and C.G.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sørensen, C.G.; Pesonen, L.; Bochtis, D.D.; Vougioukas, S.G.; Suomi, P. Functional requirements for a future farm management information system. Comput. Electron. Agric. 2011, 76, 266–276. [Google Scholar] [CrossRef]
  2. Angelopoulou, T.; Tziolas, N.; Balafoutis, A.; Zalidis, G.; Bochtis, D. Remote Sensing Techniques for Soil Organic Carbon Estimation: A Review. Remote Sens. 2019, 11, 676. [Google Scholar] [CrossRef] [Green Version]
  3. Freidenreich, A.; Barraza, G.; Jayachandran, K.; Khoddamzadeh, A.A. Precision Agriculture Application for Sustainable Nitrogen Management of Justicia brandegeana Using Optical Sensor Technology. Agriculture 2019, 9, 98. [Google Scholar] [CrossRef] [Green Version]
  4. Liakos, K.; Busato, P.; Moshou, D.; Pearson, S.; Bochtis, D. Machine Learning in Agriculture: A Review. Sensors 2018, 18, 2674. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Marino, S.; Alvino, A. Detection of Spatial and Temporal Variability of Wheat Cultivars by High-Resolution Vegetation Indices. Agronomy 2019, 9, 226. [Google Scholar] [CrossRef] [Green Version]
  6. Bochtis, D.D.; Sørensen, C.G.; Vougioukas, S.G. Path planning for in-field navigation-aiding of service units. Comput. Electron. Agric. 2010, 74, 80–90. [Google Scholar] [CrossRef]
  7. Jensen, M.A.F.; Bochtis, D.; Sorensen, C.G.; Blas, M.R.; Lykkegaard, K.L. In-field and inter-field path planning for agricultural transport units. Comput. Ind. Eng. 2012, 63, 1054–1061. [Google Scholar] [CrossRef]
  8. Bochtis, D.; Griepentrog, H.W.; Vougioukas, S.; Busato, P.; Berruto, R.; Zhou, K. Route planning for orchard operations. Comput. Electron. Agric. 2015, 113, 51–60. [Google Scholar] [CrossRef]
  9. Bochtis, D.D.; Vougioukas, S.G. Minimising the non-working distance travelled by machines operating in a headland field pattern. Biosyst. Eng. 2008, 101, 1–12. [Google Scholar] [CrossRef]
  10. Conesa-Muñoz, J.; Bengochea-Guevara, J.M.; Andujar, D.; Ribeiro, A. Route planning for agricultural tasks: A general approach for fleets of autonomous vehicles in site-specific herbicide applications. Comput. Electron. Agric. 2016, 127, 204–220. [Google Scholar] [CrossRef]
  11. Hameed, I.A.; Bochtis, D.D.; Sorensen, C.G. Driving angle and track sequence optimization for operational path planning using genetic algorithms. Appl. Eng. Agric. 2011, 27, 1077–1086. [Google Scholar] [CrossRef]
  12. Spekken, M.; de Bruin, S.; Molin, J.P.; Sparovek, G. Planning machine paths and row crop patterns on steep surfaces to minimize soil erosion. Comput. Electron. Agric. 2016, 124, 194–210. [Google Scholar] [CrossRef]
  13. Zhou, K.; Bochtis, D. Route Planning For Capacitated Agricultural Machines Based On Ant Colony Algorithms. In Proceedings of the 7th International Conference on Information and Communication Technologies in Agriculture, Food and Environment, Kavala, Greece, 17–20 September 2015; pp. 163–173. [Google Scholar]
  14. Edwards, G.; Jensen, M.A.F.; Bochtis, D.D. Coverage planning for capacitated field operations under spatial variability. Int. J. Sustain. Agric. Manag. Inform. 2015, 1, 120–129. [Google Scholar] [CrossRef]
  15. Jin, J.; Tang, L. Coverage path planning on three-dimensional terrain for arable farming. J. Field Robot. 2011, 28, 424–440. [Google Scholar] [CrossRef]
  16. Jin, J.; Tang, L. Optimal coverage path planning for arable farming on 2D surfaces. Trans. ASAE 2010, 53, 283–295. [Google Scholar] [CrossRef]
  17. Oksanen, T.; Visala, A. Coverage path planning algorithms for agricultural field machines. J. Field Robot. 2009, 26, 651–668. [Google Scholar] [CrossRef]
  18. Zhou, K.; Leck Jensen, A.; Sørensen, C.G.; Busato, P.; Bothtis, D.D. Agricultural operations planning in fields with multiple obstacle areas. Comput. Electron. Agric. 2014, 109, 12–22. [Google Scholar] [CrossRef]
  19. Palmer, R.J.; Wild, D.; Runtz, K. Improving the Efficiency of Field Operations. Biosyst. Eng. 2003, 84, 283–288. [Google Scholar] [CrossRef]
  20. Taïx, M.; Souères, P.; Frayssinet, H.; Cordesses, L. Path planning for complete coverage with agricultural machines. Springer Tracts Adv. Robot. 2006, 24, 549–558. [Google Scholar]
  21. Oksanen, T.; Visala, A. Path Planning Algorithms for Agricultural Machines. Agric. Eng. Int. CIGR J. Sci. Res. Dev. 2007. [Google Scholar]
  22. Hameed, I.A.; Bochtis, D.D.; Sørensen, C.G.; Nøremark, M. Automated generation of guidance lines for operational field planning. Biosyst. Eng. 2010, 107, 294–306. [Google Scholar] [CrossRef]
  23. Hameed, I.A.; La Cour-Harbo, A.; Osen, O.L. Side-to-side 3D coverage path planning approach for agricultural robots to minimize skip/overlap areas between swaths. Rob. Auton. Syst. 2016, 76, 36–45. [Google Scholar] [CrossRef]
  24. Luck, J.D.; Pitla, S.K.; Shearer, S.A.; Mueller, T.G.; Dillon, C.R.; Fulton, J.P.; Higgins, S.F. Potential for pesticide and nutrient savings via map-based automatic boom section control of spray nozzles. Comput. Electron. Agric. 2010, 70, 19–26. [Google Scholar] [CrossRef]
Figure 1. Tracks are represented by red lines and green areas are the covered areas by following the designated tracks. In (a) there are uncovered areas (yellow); in order to cover these areas, the tracks have to be extended (b).
Figure 1. Tracks are represented by red lines and green areas are the covered areas by following the designated tracks. In (a) there are uncovered areas (yellow); in order to cover these areas, the tracks have to be extended (b).
Agronomy 10 00083 g001
Figure 2. Examples of a ring (a) and a polygon made up of rings (b).
Figure 2. Examples of a ring (a) and a polygon made up of rings (b).
Agronomy 10 00083 g002
Figure 3. Example of an envelope of a polygon. This is the minimum bounding envelope.
Figure 3. Example of an envelope of a polygon. This is the minimum bounding envelope.
Agronomy 10 00083 g003
Figure 4. Buffer polygons (green) with offset distance d , where l is either a straight line segment (a) or a polyline (b).
Figure 4. Buffer polygons (green) with offset distance d , where l is either a straight line segment (a) or a polyline (b).
Agronomy 10 00083 g004
Figure 5. Illustrated example of operator projection (a) and point union (b).
Figure 5. Illustrated example of operator projection (a) and point union (b).
Agronomy 10 00083 g005
Figure 6. Headland area consisting of rings inside the field and outside the obstacles. Black rings are field and obstacle boundaries, blue rings are headland passes and red rings are the resultant headland area boundaries.
Figure 6. Headland area consisting of rings inside the field and outside the obstacles. Black rings are field and obstacle boundaries, blue rings are headland passes and red rings are the resultant headland area boundaries.
Agronomy 10 00083 g006
Figure 7. The bounding envelope e of the field is covered by a set of straight lines that are parallel to the reference line l.
Figure 7. The bounding envelope e of the field is covered by a set of straight lines that are parallel to the reference line l.
Agronomy 10 00083 g007
Figure 8. Generation of polygons from initial tracks for three case steps. (a) generate buffer polygon p buf using operator Π w / 2   t i for an initial track t i ; (b) find p int as the intersection of p buf and inner field border b f ; (c) obtain the subtracted area p int using operator Δ .
Figure 8. Generation of polygons from initial tracks for three case steps. (a) generate buffer polygon p buf using operator Π w / 2   t i for an initial track t i ; (b) find p int as the intersection of p buf and inner field border b f ; (c) obtain the subtracted area p int using operator Δ .
Agronomy 10 00083 g008
Figure 9. (a) The (blue) projection points of corresponding (red) initial points; (b) The final tracks and corresponding rows; (c) The generated field representation.
Figure 9. (a) The (blue) projection points of corresponding (red) initial points; (b) The final tracks and corresponding rows; (c) The generated field representation.
Agronomy 10 00083 g009
Figure 10. The individual steps of generation of the first curved track.
Figure 10. The individual steps of generation of the first curved track.
Agronomy 10 00083 g010
Figure 11. An illustration of generated overlapped area (red area) for each row.
Figure 11. An illustration of generated overlapped area (red area) for each row.
Agronomy 10 00083 g011
Figure 12. The selected fields 2 (a) and 10 (b) (presented also in Table 3) and the selected direction reference lines (red marked lines) used in the scenario tests.
Figure 12. The selected fields 2 (a) and 10 (b) (presented also in Table 3) and the selected direction reference lines (red marked lines) used in the scenario tests.
Agronomy 10 00083 g012
Figure 13. Field geometrical representations for direction (d1,d2,d3,d4) with 6 m working width.
Figure 13. Field geometrical representations for direction (d1,d2,d3,d4) with 6 m working width.
Agronomy 10 00083 g013
Figure 14. Field geometrical representations for direction (d1,d2,d3,d4) with 6 m working width.
Figure 14. Field geometrical representations for direction (d1,d2,d3,d4) with 6 m working width.
Agronomy 10 00083 g014
Table 1. Illustration of intersection ( A , B ) and subtraction Δ   ( A ,   B ) . Results of the operations are marked green.
Table 1. Illustration of intersection ( A , B ) and subtraction Δ   ( A ,   B ) . Results of the operations are marked green.
Input GeometriesIntersection ( A , B ) Subtraction Δ   ( A ,   B )
Agronomy 10 00083 i001 Agronomy 10 00083 i002 Agronomy 10 00083 i003
Agronomy 10 00083 i004 Agronomy 10 00083 i005 Agronomy 10 00083 i006
Table 2. Illustration of the offset operator for polygon, polyline and line segment with offset width d . The direction of both lines is from bottom left to top right. The green lines and rings are the generated geometries by the offset operator ± d g .
Table 2. Illustration of the offset operator for polygon, polyline and line segment with offset width d . The direction of both lines is from bottom left to top right. The green lines and rings are the generated geometries by the offset operator ± d g .
Polygon OffsetPolyline OffsetLine Offset
Agronomy 10 00083 i007 Agronomy 10 00083 i008 Agronomy 10 00083 i009
Table 3. Computational time for different fields with different number of obstacles.
Table 3. Computational time for different fields with different number of obstacles.
Field IDArea (ha)Shape and Reference LineComputation Time (s)Track Type
w = 2 m w = 4 m w = 6 m
110.27 Agronomy 10 00083 i0100.980.73 0.60Straight
222.78 Agronomy 10 00083 i0119.635.422.59Curved
353.06 Agronomy 10 00083 i01219.626.412.72Curved
437.27 Agronomy 10 00083 i01314.224.832.86 Curved
515.56 Agronomy 10 00083 i0144.822.120.63Curved
663.27 Agronomy 10 00083 i0152.011.281.12 Straight
730.27 Agronomy 10 00083 i01624.516.813.13Curved
837.41 Agronomy 10 00083 i0171.781.221.01 Straight
927.58 Agronomy 10 00083 i01818.26.223.62 Curved
1034.51 Agronomy 10 00083 i0191.580.970.73 Straight
1174.98 Agronomy 10 00083 i0201.570.940.27 Straight
1236.3 Agronomy 10 00083 i0211.951.231.01 Straight
Table 4. The results of field representation when using different straight reference lines.
Table 4. The results of field representation when using different straight reference lines.
w = 4 m w = 6 m
d1d2d3d4d1d2d3d4
Total length of tracks (m)80,44180,64980,78780,54151,65251,79951,96751,655
Number of tracks260272262216176184180149
Overlapped area (ha)0.280.370.420.320.480.570.670.49
Table 5. The results of field representation when using both straight and curved reference lines.
Table 5. The results of field representation when using both straight and curved reference lines.
w = 4 mw = 6 m
d1
Curved
d2
Curved
d3
Straight
d4
Straight
d1
Curved
d2
Curved
d3
straight
d4
Straight
Total length of tracks (m)52,02751,79752,08052,06833,35033,13133,35833,355
Number of tracks137178189999111912599
Overlapped area (ha)0.200.110.230.330.220.180.340.33

Share and Cite

MDPI and ACS Style

Zhou, K.; Jensen, A.L.; Bochtis, D.; Nørremark, M.; Kateris, D.; Sørensen, C.G. Metric Map Generation for Autonomous Field Operations. Agronomy 2020, 10, 83. https://0-doi-org.brum.beds.ac.uk/10.3390/agronomy10010083

AMA Style

Zhou K, Jensen AL, Bochtis D, Nørremark M, Kateris D, Sørensen CG. Metric Map Generation for Autonomous Field Operations. Agronomy. 2020; 10(1):83. https://0-doi-org.brum.beds.ac.uk/10.3390/agronomy10010083

Chicago/Turabian Style

Zhou, Kun, Allan Leck Jensen, Dionysis Bochtis, Michael Nørremark, Dimitrios Kateris, and Claus Grøn Sørensen. 2020. "Metric Map Generation for Autonomous Field Operations" Agronomy 10, no. 1: 83. https://0-doi-org.brum.beds.ac.uk/10.3390/agronomy10010083

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop