2. Control Methods Used in Agricultural Vehicle Path Tracking Control
Path tracking control technology is to calculate and obtain vehicle motion parameters, such as vehicle speed, steering wheel angle, etc., based on vehicle kinematic or dynamic modeling according to the algorithm, so that the vehicle can reach and track the predefined work path. The basic principle is depicted in Figure 2. The operating accuracy of agricultural machinery in autonomous driving depends on the control algorithms so that high-precision algorithms can improve the quality and efficiency of agricultural machinery operations. The environmental conditions of different fields are different, and the types of agricultural machinery used are also different.
Figure 2. Block diagram of the path tracking control system.
2.1. Dry Field Agricultural Machinery
The essence of path tracking is that under the developed control algorithm, the target vehicle can track the planned path within a certain accuracy range so that the vehicle can work along the planned path. Tractors can form different operating units with other agricultural machinery to complete tasks such as plowing, sowing, fertilization, and cultivation. The operating environment of tractors is complex and changeable, and the driving skills of drivers vary from person to person, resulting in problems such as low efficiency, decreased operation quality, and waste of land resources in field operation. In order to address these issues, many experts have conducted research on the path-tracking control technology for autonomous tractors. Backman et al.
[14] developed a 4 WS tractor path tracking algorithm, which uses the tractor’s kinematic and dynamic model and the linear control law to control the steering of the tractor. Winter wheat sowing test results showed that the lateral tracking deviation of straight sowing is less than 0.05 m, and the heading angle tracking deviation is less than 1 degree. To improve the tractor’s ability to track variable curvature paths, Wu et al.
[12] designed a variable curvature path tracking method based on the front wheel angle feedforward compensation strategy, which comprehensively considers the driving speed and target path curvature to adjust the look-ahead distance dynamically.
The agricultural land surface usually fluctuates greatly, and tractors will be affected by interference, such as the interaction between the supporting agricultural machinery and the uncertain ground. When wheel slip occurs, the tracking error of tractors will increase and even affect subsequent agricultural production activities. Taghia et al.
[15] developed a sliding mode controller with a nonlinear perturbation observer, and the new controller performed better when slip occurred compared with backstepping controllers and model predictive controllers. Ding et al.
[16] constructed a second-order sliding mode (SOSM) controller for a tractor path tracking system, fully considering longitudinal and lateral wheel slips. Ji et al.
[17] proposed a novel adaptive second-order sliding mode controller (ASOSM), which alleviates the chattering problem in traditional sliding mode control and improves the convergence speed and anti-interference ability of the system. Ge et al.
[18] proposed a novel adaptive sliding mode control (ASMC) method for path tracking of unmanned agricultural vehicles. This method is robust in the presence of parameter uncertainty, disturbances, and changing road conditions. During the straight-line operation of the tractor, stable high-speed driving will improve its work efficiency, but when turning on the ground, the driving speed should be reduced to improve the stability of the steering and reduce the turning distance. However, influenced by complex environments and uncertain external disturbances, when the tractor speed increases, the defects such as nonlinearity, hysteresis, and instability of the tractor-field path system become more prominent, which will affect system performance. Combined with optimal control theory, Han et al.
[19] designed a dual-parameter optimal control algorithm based on speed and steering angle. Zhang et al.
[20] designed a dual objective joint sliding mode control algorithm to solve the influence of tractor speed on the performance of the navigation control system. The field test platform of the tractor’s automatic navigation control system is shown in
Figure 3. This algorithm achieves adaptive adjustment of speed while ensuring stable straight-line path tracking.
Figure 3. Tractor automatic navigation control system test platform.
The pure pursuit control method has the characteristics of simulating human driving behavior with few control parameters, but in agricultural scenes, the robustness of preview point selection is poor and cannot be adjusted adaptively. In the study of pure pursuit model look-ahead distance, dynamic look-ahead distance performs better in path tracking than fixed look-ahead distance, although better tracking accuracy can be obtained when the look-ahead distance is equal to the wheel distance. To address the problem of poor adaptability of traditional pure pursuit algorithms to speed changes, Jia
[21] proposed an improved pure pursuit algorithm on the basis of a seeker optimization algorithm (SOA), which can calculate the look-ahead distance online using the fitness function. The improved pure pursuit model algorithm can effectively resist the influence of speed changes. Zhang et al.
[22] used the Dongfanghong 1104-C tractor as the test platform to determine the look-ahead distance in the pure pursuit model in real-time through particle swarm optimization (PSO). Li et al.
[23] and Zhang et al.
[24] developed a path-tracking method for agricultural machinery on the basis of the fuzzy adaptive pure pursuit model, which realized online real-time adjustment of look-ahead distance. The developed navigation controller has the advantages of short rise time and small overshot. Zhang et al.
[24] developed the automatic navigation operation system of a crawler-type rape seeder, as shown in
Figure 4. Zhang et al.
[25] used deep reinforcement learning (DRL) to improve the pure pursuit model algorithm and derive correction commands to reduce tracking errors due to the improper selection of preview points. Yang et al.
[26] designed a path-tracking algorithm based on the optimal target point, which searched for the optimal target point in a forward-looking area using an evaluation function.
Figure 4. Automatic navigation system for crawler-type rape seeder.
The quality and efficiency of manual harvesting operations largely depend on the driver’s driving skills. Applying automatic navigation technology to grain crop harvesting will help improve the quality, efficiency, and intelligence level of combined harvesters. To improve the quality of corn harvesting, Zhang et al.
[27] developed an automatic tracking system for the corn harvester, which controlled the harvester by a pure pursuit model algorithm and dynamically adjusted the look-ahead distance by fuzzy logic. In response to the problem of missing cuts during the straight-line tracking harvesting operation of a combine harvester, Ding et al.
[28] developed a single-neuron PID navigation controller for combine harvesters. Single-neuron PID can achieve rapid adjustment of control parameters through self-learning, which has the characteristics of small overshoot and fast entry into a steady state. The assisted driving system of a combined harvester with intermediate angle error can lead to path tracking deviation, which will limit the efficiency of the harvesting operation. Qiao et al.
[29] proposed an improved path-tracking controller with mid-angle adaptive calibration. Hu et al.
[30] developed a path-tracking PD controller for peanut harvesters. When the harvester operates automatically, the average absolute deviation and maximum deviation are 5.12 cm and 12.2 cm, respectively, which can ensure that the harvesting mechanism is aligned with the peanut row to realize digging and harvesting.
2.2. Paddy Field Agricultural Machinery
In the muddy and slippery rice field environment with uneven ground, compared with dry field agricultural machinery, paddy field machinery such as rice seeder and rice transplanter are more prone to sideslip, and even rolling and pitching, increasing the difficulty of automatic navigation of agricultural machinery. Most existing unmanned rice field agricultural machinery takes the front of the vehicle as the measurement and control object. There is a gap between the front machinery and rear implements, and the motion posture of the rear implements changes greatly relative to the front machinery, causing inconsistent travel trajectories between the front and the rear, leading to a decrease in straight-line operation accuracy and quality. In response to the above problems, He et al.
[31] developed an unmanned path-tracking control method for agricultural rice machinery based on model predictive control based on the pose estimation of agricultural rice machinery. The experimental results indicate that this method can effectively suppress abrupt lateral position deviations caused by the relative position and attitude changes of the machine. Wei et al.
[32] used GPS receivers and onboard sensors to gain the position and attitude information of rice transplanters and used the PID control method to construct a closed-loop steering control system, which achieved automatic navigation and headland steering of rice transplanters. In the research on the automatic driving of rice seeders, Zhang et al.
[33] proposed a control strategy that uses fuzzy logic to adjust the PD controller parameter Kd adaptively. Compared with the PD controller with fixed parameters and the pure pursuit model control method, this method has a smaller overshoot, better robustness, and faster response speed. Tang et al.
[34] and Shi et al.
[35] established a fuzzy control model to adjust the look-ahead distance of the pure pursuit model in real-time. This method is adaptable to different vehicle speeds and can avoid oscillations when the rice transplanter operates at high speed, effectively improving the system’s robustness. Wu et al.
[36][37] designed a fast terminal sliding mode controller with a nonlinear disturbance observer, which can improve the anti-interference ability of rice seeders in paddy fields. The automatic driving control system of the rice seeding machine is shown in
Figure 5. Chi et al.
[38] linearized the kinematic model of the rice transplanter in Taylor series form and developed a path-tracking controller using a model prediction algorithm, which can track linear and curve paths.
Figure 5. Automatic driving control system for rice seeding machine.
In the rice plant protection operation, the plant protection machinery needs to overcome the sliding interference caused by the muddy road surface of the paddy field and try to avoid rolling the rice seedlings, which increases the difficulty for the precise path tracking of rice field agricultural machinery. To solve the problems of driving wheel slipping and sinking in the paddy field, Wang et al.
[39] constructed a layered path tracking strategy with model predictive control and fuzzy slip rate on the basis of the linear time-varying (LTV) kinematics model of the high clearance sprayer, which improves the tracking accuracy of the sprayer in muddy and slippery field. Liu et al.
[40] developed a fuzzy adaptive predictive controller using model predictive theory, which can improve the robustness of the sprayer path-tracking. To improve the anti-interference ability and stability of the plant protection machinery, Lin et al.
[41] proposed a path-tracking control method for rice field plant protection machines, which solved the chattering of the sliding mode control algorithm. Compared with wheeled tractors, tracked tractors have a large grounding area and are not easy to sink, making them widely suitable for paddy fields. However, the sliding phenomenon for tracked tractors in paddy fields is common. Most of the relevant research establishes control models under the assumption that tractors do not slip, which is difficult to achieve satisfactory accuracy. Jia et al.
[42] studied the NF-752 tracked tractor mainly used for paddy field tillage, and comprehensively considered the effects of longitudinal speed and slip coefficient of both tracks. They proposed a path-tracking method based on a course control model, which to some extent, overcame the influence of slip-on control accuracy.
2.3. Orchard Agricultural Machinery
In the case of labor shortage and rising labor costs, the development of autonomous orchard agricultural machinery is helpful in reducing the labor intensity of orchard farmers and improving the efficiency and quality of orchard operations. Bayar et al.
[43] proposed a model-based control method for orchard autonomous agricultural vehicles, which calculates the velocity and wheel angle based on the vehicle kinematics model, thereby improving the path tracking accuracy. Thanpattranon et al.
[44] developed a navigation system suitable for curve path tracking in orchards, and the average deviation of path tracking during the experiment was 0.275 m. Based on RTK-BDS positioning technology, Xiong et al.
[45] developed a straight-line path-tracking controller for the orchard sprayer. When the sprayer speed is 2 km/h, the maximum linear tracking deviation is 0.13 m, and the average tracking deviation is less than 0.03 m, which can effectively achieve accurate straight-line path tracking of the orchard. To ensure the high robustness and speed adaptability of the navigation controller, Xue et al.
[46] developed an orchard tractor path-tracking controller. Simulation test results showed that the controller can track the straight line, and when the tractor turns, the average lateral errors at 2.5 m/s and 5 m/s are 7 cm and 13 cm, respectively. Opiyo et al.
[47] designed a machine vision navigation system based on the central axis for autonomous orchard robots, and the fuzzy controller with heading and error as input can well track the medial axis.
In the study on path tracking of orchard tractors, Wu et al.
[48] used the look-ahead distance fuzzy adaptive pure pursuit model to calculate the expected wheel angle. In addition, to cope with the soft road surface of the orchard and the vibration of the tractor itself, the feedforward control is added to the pure pursuit model control to minimize the sideslip. To achieve automatic driving of agricultural machinery in orchards, Zhang et al.
[49] developed an autonomous orchard vehicle system using a two-dimensional laser, which utilizes fuzzy control to adjust the look-ahead distance of pure pursuit model dynamically. The structure of the orchard vehicle automatic platform is shown in
Figure 6. Orchards have a high planting density, and low and narrow working passages, and small tracked tractors have the advantages of small size and strong terrain adaptability, which are widely used in orchards
[50]. Liu et al.
[51] designed a path-tracking algorithm using a virtual radar model for small, tracked tractors. The algorithm describes the relative position between vehicles and paths with a virtual radar map and generates driving instructions through a deep neural network to control the tractor. Compared with the fuzzy control algorithm, this algorithm has higher accuracy and driving stability and has better adaptability to orchard working paths.
Figure 6. Orchard vehicle automatic test platform.
2.4. Agricultural Robots and Facility Agricultural Machinery
Autonomous agricultural robots are widely used in pesticide spraying, weeding, planting, and field biological and environmental information collection. The ground conditions constantly change during the steering process, making it difficult to establish accurate mathematical models for controlled vehicles. In the research of agricultural wheeled robot path tracking, Li et al.
[52] introduced a radial basis function (RBF) neural network to estimate the uncertainty disturbance in real-time and then designed an adaptive sliding mode control method, which can improve the system robustness while reducing chattering. Gökçe et al.
[53] used a PID control strategy to control the agricultural robot and optimized the controller parameters through the PSO algorithm. In order to adapt to changes in speed and road, Sun et al.
[54] proposed an improved path-tracking control algorithm based on the fuzzy Stanley model (FSM) and PSO. Cui et al.
[55] proposed an improved Stanley model path-tracking algorithm based on the fuzzy algorithm, which adjusts the gain coefficient in real-time. In the above research on the improvement of the Stanley model algorithm, the fuzzy algorithm improves the tracking accuracy of the automatic turning, and the particle swarm optimization algorithm can further optimize the front wheel steering angle and decision-making. The agricultural tracked robot is a multi-input and multi-output system, having the characteristics of time-varying, nonlinearity, and uncertainty, which is easily affected by parameter disturbance, thereby causing negative impacts on the system
[56]. Song et al.
[57] designed a path-tracking strategy based on heuristic dynamic programming (HDP) for tracked agricultural robots, which can accurately track multiple complex straight-line paths. The sliding mode control method can adjust the uncertainties and parameter disturbances in the system and track the path in an exponentially convergent manner
[58]. Li et al.
[59] designed a tracked robot path-tracking system on the basis of a sliding mode variable structure algorithm.
The autonomous mobile operating platform in agricultural facilities can undertake tasks such as autonomous working and autonomous transportation of agricultural materials, which plays an important role in the development of facility agriculture. The space in agricultural facilities is small, and the mobile operating platform needs to change the driving direction frequently. Wang et al.
[60] designed an automatic tracking platform for greenhouse fruit and vegetable picking and transportation based on Kinect sensing technology. The system uses the pure pursuit model method to track the expected path and uses the fuzzy algorithm to determine the look-ahead distance dynamically. In order to adapt to the rectangular path tracking working conditions, Yao et al.
[61] used ultra-wideband (UWB) wireless positioning technology to obtain high-precision positioning information of the mobile platform and proposed a dynamic look-ahead distance determination method based on the deviation. The improved pure pursuit model algorithm can meet the demand for automatic navigation of mobile platforms in agricultural facilities. Chai et al.
[62] improved the pure pursuit model by PSO and selected the optimal look-ahead distance according to the platform’s real-time position. Based on the kinematic model of a 4WIS-4WID vehicle, as shown in
Figure 7, Xu et al.
[63] calculate the optimal look-ahead distance using a fuzzy algorithm.
Figure 7. Test prototype and test environment.
The prominent problem faced by path-tracking technology based on the model predictive model is real-time performance. Linearization prediction models have better real-time performance than nonlinear prediction models, but linearization prediction models have the problem of weakening the controller’s ability to respond to path curvature and heading changes. Oyelere et al.
[64] solved the path-tracking problem of autonomous ground vehicles (AGV) using nonlinear model predictive control (NMPC) and linear model predictive control (LMPC) and proved through experiments that LMPC has better real-time performance than NMPC. Zhang et al.
[65] proposed a path-tracking method on the basis of linear time-varying model predictive control (LTVMPC). The reference path of agricultural robots usually consists of straight lines and arcs, with significant curvature changes, so linearized prediction models are not suitable for optimizing real-time performance. Liu et al.
[66] proposed a path-tracking method based on nonlinear model predictive control. Test results showed that the developed controller has a smaller deviation than the linear model predictive controller when tracking linear and circular paths. Aiming at the poor real-time performance of nonlinear model predictive control, Bai et al.
[67] proposed to optimize by reducing the number of control steps or lowering the control frequency. Experimental results show that reducing the number of control steps is more suitable for agricultural robots with high flexibility.
2.5. Agricultural Articulated Vehicle
Articulated vehicles mainly consist of two parts, the front, and the rear, connected by a rigid hinge body in the middle. The structural characteristics of the articulated vehicle not only reduce the turning radius, but also ensure the adhesion between the tire and the ground in rough terrain, making them suitable for transportation operations in non-structural rough terrain. Agricultural wheeled articulated vehicles experience severe vibrations when driving on rough terrain such as farmland. Compared with the traditional front-axle steering structure, the steering structure of the articulated vehicle allows both the front and the rear car body to move relative to the ground during the steering process, which increases the difficulty of path tracking. Zhao et al.
[68] proposed a sliding mode variable structure path tracking controller for articulated agricultural vehicles. To suppress chattering, the symbolic function was replaced by a continuous function, and the Lyapunov function was used to prove its stability. Shao et al.
[69] proposed an adaptive PID controller, which used the reinforcement learning algorithm to tune PID parameters adaptively. Reinforcement learning adaptive PID controllers have smaller overshot and vibrations than traditional ones so that the articulated vehicle can track the predetermined path more accurately. To improve the response speed of articulated agricultural vehicles, Meng et al.
[70] proposed a linear quadratic regulator-genetic algorithm (LQR-GA) path-tracking method based on preview information. Preview information can improve the system response speed, and the genetic algorithm can optimize the control effect.
In order to keep the tractor and trailer on the same working trajectory, Backman et al.
[14] designed a nonlinear model predictive path-tracking controller for the tractor-trailer system. During the straight-line path tracking, the lateral error of the trailer is much less than 10 cm. To improve the trajectory tracking performance of autonomous tractor-trailer systems, Kayacan et al.
[71] combined fast-distributed nonlinear model predictive control with nonlinear movement level estimation for state and parameter estimation. The small agricultural tractor–trailer system is shown in
Figure 8. The proposed method can improve the path-tracking accuracy of tractor-trailer systems and robustness to environmental disturbances. Apart from the development and improvement of control methods by the researchers mentioned above, commercial companies have proposed commercial solutions for autonomous tractor-trailer systems, such as John Deere’s iGuide and iSteer and Trimble’s TrueGuide. The difference between iGuide and iSteer, which is primarily used for straight-line path tracking, is that iGuide is a passive guidance solution where the implement does not have a steering system, while iSteer is an active guidance solution where both the tractor and the implement have a steering system.
Figure 8. The tractor-trailer system.