Designing autonomous robotic systems for monitoring tasks in critical security scenarios requires more rigorous verification criteria. The losses associated with unsuccessful practical experiments are immeasurable, ranging from the simple loss of high-value-added equipment to those related to loss of life. This reality justifies the need to adopt an extensive framework of tools for realistic, efficient, and responsive computer simulation. This article proposes a novel integration architecture and combines open-source tools to promote the successful implementation of autonomous robotic systems in monitoring tasks. The proposed solution relies on consolidated tools like Robot Operating System (ROS), Gazebo Simulator, and ArduPilot FCU (Flight Control Unit). It includes full support for implementing XITL techniques (such as Model, Software, and Hardware) – in the Loop. Experimental results demonstrate the proposal’s effectiveness for a new model of autonomous surface vehicles (ASVs) in a realistic environment, dedicated to environmental monitoring in challenging natural conditions, commonly found in a stretch of the Madeira River – Brazil, specifically at Santo Antônio hydroelectric plant.

Navigation is an important skill required for an autonomous robot, as information about the location of the robot is necessary for making decisions about upcoming events. The objective of the localization technique is “to know about the location of the collected data.” In previous works, several deep learning methods were used to detect localization, but none of them gives sufficient accuracy. To address this issue, an Enhanced Capsule Generation Adversarial Network and optimized Dual Interactive Wasserstein Generative Adversarial Network for landmark detection and localization of autonomous robots in outdoor environments (ECGAN-DIWGAN-RSO-LAR) is proposed in this manuscript. Here, the outdoor robot localization dataset is taken from the Virtual KITTI dataset. It contains two phases, which are landmark detection and localization. The landmark detection phase is determined using Enhanced Capsule Generation Adversarial Network for detecting the landmark of the captured image. Then the robot localization phase is determined using Dual Interactive Wasserstein Generative Adversarial Network (DIWGAN) for determining the robot location coordinates as well as compass orientation from identified landmarks. After that, the weight parameters of the DIWGAN are optimized by Rat Swarm Optimization (RSO) algorithm. The proposed ECGAN-DIWGAN-RSO-LAR is implemented in Python. The efficiency of the proposed ECGAN-DIWGAN-RSO-LAR technique shows higher accuracy of 22.67%, 12.45 %, and 8.89% compared to the existing methods.

Pouch-type actuators have recently garnered significant interest and are increasingly utilized in diverse fields, including soft wearable robotics and prosthetics. This is largely due to their lightweight, high output force, and low cost. However, the inherent hysteresis behavior markedly affects the stability and force control of pouch-type driven systems. This study proposes a modified generalized Prandtl–Ishlinskii (MGPI) model, which includes generalized play operators, the tangent envelope function, and one-sided dead-zone operators, to describe the asymmetric and non-convex hysteresis characteristics of pouch-type actuators. Compared to a classical Prandtl–Ishlinskii (PI) model incorporating one-sided dead-zone functions, the MGPI model exhibits smaller relative errors at six different air pressures, demonstrating its capability to accurately describe asymmetric and non-convex hysteresis curves. Subsequently, the MGPI hysteresis model is integrated with displacement sensing technology to establish a load compensation control system for maintaining human posture. Four healthy subjects are recruited to conduct a 1 kg load compensation test, achieving efficiencies of 85.84%, 84.92%, 83.63%, and 68.86%, respectively.

This article addresses the localization problem in robotic autonomous luggage trolley collection at airports and provides a systematic evaluation of different methods to solve it. The robotic autonomous luggage trolley collection is a complex system that involves object detection, localization, motion planning and control, manipulation, etc. Among these components, effective localization is essential for the robot to employ subsequent motion planning and end-effector manipulation because it can provide a correct goal position. This article explores four popular and representative localization methods for object localization in luggage trolley collection: radio frequency identification (RFID), Keypoints, ultrawideband (UWB), and Reflectors. A qualitative evaluation framework is constructed to assess performance, encompassing Localization Accuracy, Mobile Power Supplies, Coverage Area, Cost, and Scalability. Furthermore, a series of quantitative experiments concerning Localization Accuracy and Success Rate have been conducted on a real-world robotic autonomous luggage trolley collection system. The performance of various localization methods is further analyzed based on experimental results, indicating that the Keypoints method is optimally suited for indoor environments to facilitate luggage trolley collection. Significantly, these experiment results provide a valuable reference point, extending the application of indoor localization methods across diverse scenarios. A website about this work is available at https://sites.google.com/view/localization-evaluation/.

A method is proposed for identifying robot gravity and friction torques based on joint currents. The minimum gravity term parameters are obtained using the Modified Denavit–Hartenberg (MDH) parameters, and the dynamic equations are linearized. The robot’s friction torque is identified using the Stribeck friction model. Additionally, a zero-force drag algorithm is designed to address the issue of excessive start-up torque during dragging. A sinusoidal compensation algorithm is proposed to perform periodic friction compensation for each stationary joint, utilizing the identified maximum static friction torque. Experimental results show that when the robot operates at a uniform low speed, the theoretical current calculated based on the identified gravity and friction fits the actual current well, with a maximum root mean square error within 50 mA, confirming the accuracy of the identification results. The start-up torque compensation algorithm reduces the robot’s start-up torque by an average of $ 60.58\mathrm{\%}$, improving the compliance of the dragging process and demonstrating the effectiveness of the compensation algorithm.

Motion primitives play an important role in motion planning for autonomous vehicles, as they effectively address the sampling challenges inherent in nonholonomic motion planning. Employing motion primitives (MPs) is a widely accepted approach in nonholonomic motion planning based on sampling. This study specifically addresses the problem of learning from human-driving data to create human-like trajectories from predefined start-to-end states, which then serve as MP within the sampling-based nonholonomic motion planning framework. In this paper, we propose a deep learning-based method for generating MP that capture human-driving trajectory data features. By processing human-driving trajectory data, we create a Motion Primitive dataset that uniformly covers typical urban driving scenarios. Based on this dataset, a vehicle model long short-term memory neural network model is constructed to learn the features of the human-driving trajectory data. Finally, a framework for the generation of MP for practical applications is given based on this neural network. Our experiments, which focus on the dataset, the MMP generation network, and the generation process, demonstrate that our method significantly improves the training efficacy of the MP generation network. Additionally, the MP generated by our method exhibit higher accuracy compared to traditional methods.

To meet the high-precision positioning requirements for hybrid machining units, this article presents a geometric error modeling and source error identification methodology for a serial–parallel hybrid kinematic machining unit (HKMU) with five axis. A minimal kinematic error modeling of the serial–parallel HKMU is established with screw-based method after elimination of redundant errors. A set of composite error indices is formulated to describe the terminal accuracy distribution characteristics in a quantitative manner. A modified projection method is proposed to determine the actual compensable and noncompensable source errors of the HKMU by identifying such transformable source errors. Based on this, the error compensation and comparison analysis are carried out on the exemplary HKMU to numerically verify the effectiveness of the proposed modified projection method. The geometric error evaluations reveal that the parallel module has a larger impacts on the terminal accuracy of the platform of the HKMU than the serial module. The error compensation results manifest that the modified projection method can find additional compensable source errors and significantly reduce the average and maximum values of geometric errors of the HKMU. Hence, the proposed methodology can be applied to improve the accuracy of kinematic calibration of the compensable source errors and can reduce the difficulty and workload of tolerance design for noncompensable source errors of such serial–parallel hybrid mechanism.

Target tracking technology is a key research area in the field of mobile robots, with wide applications in logistics, security, autonomous driving, and more. It generally involves two main components: target recognition and target following. However, the limited computational power of the mobile robot’s controller makes achieving high precision and fast target recognition and tracking a challenge. To address the challenges posed by limited computing power, this paper proposes a target-tracking control algorithm based on lightweight neural networks. First, a depthwise separable convolution-based backbone is introduced for feature extraction. Then, an efficient channel attention module is incorporated into the target recognition algorithm to minimize the impact of redundant features and emphasize important channels, thereby reducing model complexity and enhancing network efficiency. Finally, based on the data collected from visual and ultrasonic sensors, a model predictive control strategy is used to achieve target tracking. Validation of the proposed algorithm is conducted using a mobile robot equipped with Raspberry Pi 4B. Experimental results demonstrate that the proposed algorithm achieves rapid target tracking.

Descriptions of various subsets of $\mathbb{SO}(3)$ are encountered frequently in robotics, for example, in the context of specifying the orientation workspaces of manipulators. Often, the Cartesian concept of a cuboid is extended into the domain of Euler angles, notwithstanding the fact that the physical implications of this practice are not documented. Motivated by this lacuna in the existing literature, this article focuses on studying sets of rotations described by such cuboids by mapping them to the space of Rodrigues parameters, where a physically meaningful measure of distance from the origin is available and the spherical geometry is intrinsically pertinent. It is established that the planar faces of the said cuboid transform into hyperboloids of one sheet and hence, the cuboid itself maps into a solid of complicated non-convex shape. To quantify the extents of these solids, the largest spheres contained within them are computed analytically. It is expected that this study would help in the process of design and path planning of spatial robots, especially those of parallel architecture, due to a better and quantitative understanding of their orientation workspaces.

Soft robots show an advantage when conducting tasks in complex environments due to their enormous flexibility and adaptability. However, soft robots suffer interactions and nonlinear deformation when interacting with soft and fluid materials. The reason behind is the free boundary interactions, which refers to undetermined contact between soft materials, specifically containing nonlinear deformation in air and nonlinear interactions in fluid for soft robot simulation. Therefore, we propose a new approach using material point method (MPM), which can solve the free boundary interactions problem, to simulate soft robots under such environments. The proposed approach can autonomously predict the flexible and versatile behaviors of soft robots. Our approach entails incorporating automatic differentiation into the algorithm of MPM to simplify the computation and implement an efficient implicit time integration algorithm. We perform two groups of experiments with an ordinary pneumatic soft finger in different free boundary interactions. The results indicate that it is possible to simulate soft robots with nonlinear interactions and deformation, and such environmental effects on soft robots can be restored.

The two main sources of difficulty for a group of mobile robots employing sensors to find a source are robot collisions and wireless ambient noise, such as light, sound, and other sounds. This paper introduces a novel approach to multi-robot system cooperation and collision avoidance: the new modified source-seeking control with noise cancelation technology. The robot team works together on an incline of a light source field; the team’s mobility is dependent upon following the upward gradient’s direction and forming a particular movement pattern. The proposed program also takes into account each robot’s size, speed limit, obstacles, and noise. The noise cancelation technique has been used to avoid the delay and false decisions to find the target point of the source. When the noise is canceled, all control inputs to the algorithm are accurate, and the feedback decision will be true. In this study, we use the MATLAB simulation tools to test the velocity, position, time delay, and performance of each robot in the used group of robots. The simulation and practical results of the robots in searching for a light source showed very satisfactory performance compared with the results in the literature.

In this article, the performance analysis and multiobjective structure optimization of 4RRR parallel mechanism are carried out. Firstly, the 4RRR pure rotation parallel mechanism and its design route are introduced. Secondly, the Jacobian matrices in 2DoF pure rotation and 3DoF pure rotation modes are derived using the motion equations of the mechanism. Next, the singularity analysis, kinematic dexterity analysis, dynamic dexterity analysis, and stiffness analysis of the mechanism are carried out, respectively, and it is proved that there is no singularity in the mechanism in its workspace. Since the dexterity performance expression is a nonlinear piecewise function, the kinematic local comprehensive dexterity index and the dynamic local comprehensive dexterity index are proposed as the objects of analysis. Furthermore, the kinematic global comprehensive dexterity index, the dynamic global comprehensive dexterity index, and the global comprehensive stiffness index are proposed to carry out the multiobjective structural optimization. Finally, NSGA3 was used to complete the optimization, and the comprehensive optimal solution of the structure size was obtained.

The multi-robot path planning problem is an NP-hard problem. The coati optimization algorithm (COA) is a novel metaheuristic algorithm and has been successfully applied in many fields. To solve multi-robot path planning optimization problems, we embed two differential evolution (DE) strategies into COA, a self-adaptive differential evolution-based coati optimization algorithm (SDECOA) is proposed. Among these strategies, the proposed algorithm adaptively selects more suitable strategies for different problems, effectively balancing global and local search capabilities. To validate the algorithm’s effectiveness, we tested it on CEC2020 benchmark functions and 48 CEC2020 real-world constrained optimization problems. In the latter’s experiments, the algorithm proposed in this paper achieved the best overall results compared to the top five algorithms that won in the CEC2020 competition. Finally, we applied SDECOA to optimization multi-robot online path planning problem. Facing extreme environments with multiple static and dynamic obstacles of varying sizes, the SDECOA algorithm consistently outperformed some classical and state-of-the-art algorithms. Compared to DE and COA, the proposed algorithm achieved an average improvement of 46% and 50%, respectively. Through extensive experimental testing, it was confirmed that our proposed algorithm is highly competitive. The source code of the algorithm is accessible at: https://ww2.mathworks.cn/matlabcentral/fileexchange/164876-HDECOA.

This paper investigates a closed-loop visual servo control scheme for controlling the position of a fully constrained cable-driven parallel robot (CDPR) designed for functional rehabilitation tasks. The control system incorporates real-time position correction using an Intel RealSense camera. Our CDPR features four cables exiting from pulleys, driven by AC servomotors, to move the moving platform (MP). The focus of this work is the development of a control scheme for a closed-loop visual servoing system utilizing depth/RGB images. The developed algorithm uses this data to determine the actual Cartesian position of the MP, which is then compared to the desired position to calculate the required Cartesian displacement. This displacement is fed into the inverse kinematic model to generate the servomotor commands. Three types of trajectories (circular, square, and triangular) are used to test the controller’s compliance with its position. Compared to the open-loop control of the robot, the new control system increases positional accuracy and effectively handles cable behavior, various perturbations, and modeling errors. The obtained results showed significant improvements in control performance, notably reduced root mean square error and maximal error in terms of position.

The autonomous navigation and obstacle avoidance capabilities of autonomous underwater vehicles (AUVs) are essential for ensuring their safe navigation and long-term, efficient operation. However, the complexity of the marine environment poses significant challenges to safe and effective obstacle avoidance. To address this issue, this study proposes an AUV obstacle avoidance control algorithm based on offline reinforcement learning. This method adopts the Conservative Q-learning (CQL) algorithm, which is based on the Soft Actor-Critic (SAC) framework. It learns from obtained historical obstacle avoidance data and ultimately achieves a favorable obstacle avoidance control strategy. In this method, PID and SAC control algorithms are utilized to generate expert obstacle avoidance data to construct a diversified offline database. Additionally, based on the line-of-sight (LOS) guidance method and artificial potential field (APF) method, information regarding the distance and orientation of targets and obstacles is incorporated into the state space, and heading and obstacle avoidance reward terms are integrated into the reward function design. The algorithm successfully guides the AUV in autonomous navigation and dynamic obstacle avoidance in three-dimensional space. Furthermore, the algorithm exhibits a certain degree of anti-interference capability against uncertain disturbances and ocean currents, enhancing the safety and robustness of the AUV system. Simulation results fully demonstrate the feasibility and effectiveness of the intelligent obstacle avoidance method based on offline reinforcement learning. This study highlights the profound significance of offline reinforcement learning in enabling robust and reliable control systems for AUVs, paving the way for enhanced operational capabilities in challenging marine environments.

Collaborative robotics in manufacturing introduces a new era of seamless human–robot collaboration (HRC), enhancing production line efficiency and adaptability. However, guaranteeing safe interaction while maintaining performance objectives presents significant challenges. Integrating safety with optimal robot performance is paramount to minimize task time and ensure its completion. Our work introduces an architecture for safety in confined human–robot workspaces by integrating existing safety and productivity methods into a unified framework specifically designed for constrained environments. By employing an improved artificial potential field, we optimize paths based on length and bending energy and compare baseline algorithms like gradient descent algorithm and rapidly exploring random tree (RRT*). We propose an evaluation metric for system performance that objectively maps to the system’s safety and efficiency in diverse collaborative scenarios. Additionally, the architecture supports multimodal interaction, including gesture-based inputs, for intuitive control and improved operator experience. Safety measures address static and dynamic obstacles using potential fields and safety zones, with a real-time safety evaluation module adjusting trajectories under specified constraints. A performance recovery algorithm facilitates swift resumption of high-speed operations post safety interventions. Validation includes comparing the algorithmic performance through simulations and experiments using the 6-degrees of freedom UR5 robot by universal robots to identify the most suitable algorithm. Results demonstrate an 83.87% improvement in system performance compared to ideal case scenarios, validating the effectiveness of the proposed architecture, evaluation metric, and multimodal interaction in enhancing safety and productivity.

Humanoid robots are highly redundant, and finding whole-body optimal trajectories for various tasks is very complex. This paper proposes a method to find an energy-optimal, dynamically balanced, and collision-free trajectory of the 20 degrees of freedom humanoid robot in pick and place application. The task of pick and place is divided into three subtasks using the Pseudoinverse Jacobian method of redundancy resolution. The three subtasks are end effector trajectory represented by $\mathcal {T}_1$, hip trajectory represented by $\mathcal {T}_2$, and maximizing the manipulability represented by $\mathcal {T}_3$. The Pseudoinverse Jacobian method is coupled with particle swarm optimization (PSO) to find the optimal trajectories. The main contribution of this paper is the decomposition of the whole-body task of the humanoid robot into three distinct subtasks to find energy-optimal, dynamically balanced, and obstacle-free trajectories. The concept of virtual surface is used to avoid dragging objects on the table surface. The problem is optimized with Particle Swarm Optimization. Simulations were conducted to pick up and place objects from a table and constrained spaces like a drawer. The results show that the robot can pick and place objects from defined locations on the table.

The estimation of workspace for parallel kinematic machines (PKMs) typically relies on geometric considerations, which is suitable for PKMs operating under light load conditions. However, when subjected to heavy load, PKMs may experience significant deformation in certain postures, potentially compromising their stiffness. Additionally, heavy load conditions can impact motor loading performance, leading to inadequate motor loading in specific postures. Consequently, in addition to geometric constraints, the workspace of PKMs under heavy load is also constrained by mechanism deformation and motor loading performance.

This paper aims at developing a new heavy load 6-PSS PKM for multi-degree of freedom forming process. Additionally, it proposes a new method for estimating the workspace, which takes into account both mechanism deformation and motor loading performance. Initially, the geometric workspace of the machine is predicted based on its geometric configuration. Subsequently, the workspace is predicted while considering the effects of mechanism deformation and motor loading performance separately. Finally, the workspace is synthesized by simultaneously accounting for both mechanism deformation and motor loading performance, and a new index of workspace utilization rate is proposed. The results indicate that the synthesized workspace of the machine diminishes as the load magnitude and load arm increase. Specifically, under a heavy load magnitude of 6000 kN and a load arm of 200 mm, the utilization rate of the synthesized workspace is only 9.9% of the geometric workspace.

A transverse ledge climbing robot inspired by athletic locomotion is a customized robot aiming to travel through horizontal ledges in vertical walls. Due to the safety issue and complex configurations in graspable ledges such as horizontal, inclined ledges, and gaps between ledges, existing well-known vision-based navigation methods suffering from occlusion problems may not be applicable to this special kind of application. This study develops a force feedback-based motion planning strategy for the robot to explore and make feasible grasping actions as it continuously travels through reachable ledges. A contact force detection algorithm developed using a momentum observer approach is implemented to estimate the contact force between the robot’s exploring hand and the ledge. Then, to minimize the detection errors due to dynamic model uncertainties and noises, a time-varying threshold is integrated. When the estimated contact force exceeds the threshold value, the robot control system feeds the estimated force into the admittance controller to revise the joint motion trajectories for a smooth transition. To handle the scenario of gaps between ledges, several ledge-searching algorithms are developed to allow the robot to grasp the next target ledge and safely overcome the gap transition. The effectiveness of the proposed motion planning and searching strategy has been justified by simulation, where the four-link transverse climbing robot successfully navigates through a set of obstacle scenarios modeled to approximate the actual environment. The performance of the developed grasping ledge searching methods for various obstacle characteristics has been evaluated.

Optical microrobots are activated by a laser in a liquid medium using optical tweezers. To create visual control loops for robotic automation, this work describes a deep learning-based method for orientation estimation of optical microrobots, focusing on detecting 3-D rotational movements and localizing microrobots and trapping points (TPs). We integrated and fine-tuned You Only Look Once (YOLOv7) and Deep Simple Online Real-time Tracking (DeepSORT) algorithms, improving microrobot and TP detection accuracy by $\sim 3$% and $\sim 11$%, respectively, at the 0.95 Intersection over Union (IoU) threshold in our test set. Additionally, it increased mean average precision (mAP) by 3% at the 0.5:0.95 IoU threshold during training. Our results showed a 99% success rate in trapping events with no false-positive detection. We introduced a model that employs EfficientNet as a feature extractor combined with custom convolutional neural networks (CNNs) and feature fusion layers. To demonstrate its generalization ability, we evaluated the model on an independent in-house dataset comprising 4,757 image frames, where microrobots executed simultaneous rotations across all three axes. Our method provided mean rotation angle errors of $1.871^\circ$, $2.308^\circ$, and $2.808^\circ$ for X (yaw), Y (roll), and Z (pitch) axes, respectively. Compared to pre-trained models, our model provided the lowest error in the Y and Z axes while offering competitive results for X-axis. Finally, we demonstrated the explainability and transparency of the model’s decision-making process. Our work contributes to the field of microrobotics by providing an efficient 3-axis orientation estimation pipeline, with a clear focus on automation.