CRIIS

Permanent URI for this community

http://localhost:4000/handle/123456789/35
This service develops advanced solutions in automation and industrial robotics, including handlers and mobile robots, and promotes the integration of control intelligent systems and sensing.

Browse

Browsing CRIIS by Author "5157"
  • Item
    Accuracy and Repeatability Tests on HoloLens 2 and HTC Vive
    ( 2021) Soares,I ; Ricardo Barbosa Sousa ; Marcelo Petry ; António Paulo Moreira ; 5157 ; 5240 ; 7908
    Augmented and Virtual Reality have been experiencing a rapidly growth in recent years, but there is not still a deep knowledge on their capabilities and where they could be explored. In that sense, this paper presents a study on the accuracy and repeatability of the Microsoft's HoloLens 2 (Augmented Reality device) and HTC Vive (Virtual Reality device) using an OptiTrack system as ground truth. For the HoloLens 2, the method used was hand tracking, while in HTC Vive, the object tracked was the system's hand controller. A series of tests in different scenarios and situations were performed to explore what could influence the measures. The HTC Vive obtained results in the millimetre scale, while the HoloLens 2 revealed not so accurate measures (around 2 centimetres). Although the difference can seem to be considerable, the fact that HoloLens 2 was tracking the user's hand and not an inherit controller made a huge impact. The results were considered a significant step for the on going project of developing a human-robot interface to program by demonstration an industrial robot using Extended Reality, which shows great potential to succeed based on this data.
  • Item
    Active Perception Fruit Harvesting Robots - A Systematic Review
    ( 2022) Sandro Augusto Magalhães ; António Paulo Moreira ; Filipe Neves Santos ; Dias,J ; 5157 ; 7481 ; 5552
  • Item
    Advances in Agriculture Robotics: A State-of-the-Art Review and Challenges Ahead
    ( 2021) Oliveira,LFP ; António Paulo Moreira ; Manuel Santos Silva ; 5157 ; 5655
    The constant advances in agricultural robotics aim to overcome the challenges imposed by population growth, accelerated urbanization, high competitiveness of high-quality products, environmental preservation and a lack of qualified labor. In this sense, this review paper surveys the main existing applications of agricultural robotic systems for the execution of land preparation before planting, sowing, planting, plant treatment, harvesting, yield estimation and phenotyping. In general, all robots were evaluated according to the following criteria: its locomotion system, what is the final application, if it has sensors, robotic arm and/or computer vision algorithm, what is its development stage and which country and continent they belong. After evaluating all similar characteristics, to expose the research trends, common pitfalls and the characteristics that hinder commercial development, and discover which countries are investing into Research and Development (R&D) in these technologies for the future, four major areas that need future research work for enhancing the state of the art in smart agriculture were highlighted: locomotion systems, sensors, computer vision algorithms and communication technologies. The results of this research suggest that the investment in agricultural robotic systems allows to achieve short—harvest monitoring—and long-term objectives—yield estimation.
  • Item
    Advances in Forest Robotics: A State-of-the-Art Survey
    ( 2021) Oliveira,LFP ; António Paulo Moreira ; Manuel Santos Silva ; 5157 ; 5655
    The development of robotic systems to operate in forest environments is of great relevance for the public and private sectors. In this sense, this article reviews several scientific papers, research projects and commercial products related to robotic applications for environmental preservation, monitoring, wildfire firefighting, inventory operations, planting, pruning and harvesting. After conducting critical analysis, the main characteristics observed were: (a) the locomotion system is directly affected by the type of environmental monitoring to be performed; (b) different reasons for pruning result in different locomotion and cutting systems; (c) each type of forest, in each season and each type of soil can directly interfere with the navigation technique used; and (d) the integration of the concept of swarm of robots with robots of different types of locomotion systems (land, air or sea) can compensate for the time of executing tasks in unstructured environments. Two major areas are proposed for future research works: Internet of Things (IoT)-based smart forest and navigation systems. It is expected that, with the various characteristics exposed in this paper, the current robotic forest systems will be improved, so that forest exploitation becomes more efficient and sustainable.
  • Item
    Autonomous Robot Navigation for Automotive Assembly Task: An Industry Use-Case
    ( 2019) Héber Miguel Sobreira ; Germano Veiga ; António Paulo Moreira ; Rodrigues,F ; Lima,J ; Luís Freitas Rocha ; 5364 ; 5424 ; 5674 ; 5157
  • Item
    Autonomous wheelchair for patient’s transportation on healthcare institutions
    ( 2021) André Rodrigues Baltazar ; Marcelo Petry ; Manuel Santos Silva ; António Paulo Moreira ; 5157 ; 5240 ; 5655 ; 7458
    AbstractThe transport of patients from the inpatient service to the operating room is a recurrent task in a hospital routine. This task is repetitive, non-ergonomic, time consuming, and requires the labor of patient transporters. In this paper is presented a system, named Connected Driverless Wheelchair, that can receive transportation requests directly from the hospital information management system, pick up patients at their beds, navigate autonomously through different floors, avoid obstacles, communicate with elevators, and drop patients off at the designated operating room. As a result, a prototype capable of transporting patients autonomously in hospital environments was obtained. Although it was impossible to test the final developed system at the hospital as planned, due to the COVID-19 pandemic, the extensive tests conducted at the robotics laboratory facilities, and our previous experience in integrating mobile robots in hospitals, allowed to conclude that it is perfectly prepared for this integration to be carried out. The achieved results are relevant since this is a system that may be applied to support these types of tasks in the future, making the transport of patients more efficient (both from a cost and time perspective), without unpredictable delays and, in some cases, safer.
  • Item
    Benchmarking edge computing devices for grape bunches and trunks detection using accelerated object detection single shot multibox deep learning models
    ( 2023) Sandro Augusto Magalhães ; Filipe Neves Santos ; Machado,P ; António Paulo Moreira ; Dias,J ; 5157 ; 7481 ; 5552
  • Item
    Collaborative Welding System using BIM for Robotic Reprogramming and Spatial Augmented Reality
    ( 2019) Carlos Miguel Costa ; Luís Freitas Rocha ; Malaca,P ; Pedro Gomes Costa ; António Paulo Moreira ; Tavares,P ; Armando Sousa ; Germano Veiga ; 6164 ; 5152 ; 5157 ; 5159 ; 5364 ; 5674
    The optimization of the information flow from the initial design and through the several production stages plays a critical role in ensuring product quality while also reducing the manufacturing costs. As such, in this article we present a cooperative welding cell for structural steel fabrication that is capable of leveraging the Building Information Modeling (BIM) standards to automatically orchestrate the necessary tasks to be allocated to a human operator and a welding robot moving on a linear track. We propose a spatial augmented reality system that projects alignment information into the environment for helping the operator tack weld the beam attachments that will be later on seam welded by the industrial robot. This way we ensure maximum flexibility during the beam assembly stage while also improving the overall productivity and product quality since the operator no longer needs to rely on error prone measurement procedures and he receives his tasks through an immersive interface, relieving him from the burden of analyzing complex manufacturing design specifications. Moreover, no expert robotics knowledge is required to operate our welding cell because all the necessary information is extracted from the Industry Foundation Classes (IFC), namely the CAD models and welding sections, allowing our 3D beam perception systems to correct placement errors or beam bending, which coupled with our motion planning and welding pose optimization system ensures that the robot performs its tasks without collisions and as efficiently as possible while maximizing the welding quality. © 2019 Elsevier B.V.
  • Item
    Cost-Effective 4DoF Manipulator for General Applications
    ( 2021) Sandro Augusto Magalhães ; António Paulo Moreira ; dos Santos,FN ; Dias,J ; Luís Carlos Santos ; 5157 ; 7150 ; 7481
  • Item
    Driverless Wheelchair for Patient's On-Demand Transportation in Hospital Environment*
    ( 2020) André Rodrigues Baltazar ; Marcelo Petry ; Manuel Santos Silva ; António Paulo Moreira ; 5157 ; 5240 ; 5655 ; 7458
    The transport of patients from the inpatient service to the operating room is a recurrent task in the hospital routine. This task is repetitive, non-ergonomic, time consuming, and requires the labor of patient transporters. In this paper is presented the design of a driverless wheelchair under development capable of providing an on-demand mobility service to hospitals. The proposed wheelchair can receive transportation requests directly from the hospital information management system, pick-up patients at their beds, navigate autonomously through different floors, avoid obstacles, communicate with elevators, and drop patients off at the designated destination. © 2020 IEEE.
  • Item
    Evaluating the Single-Shot MultiBox Detector and YOLO Deep Learning Models for the Detection of Tomatoes in a Greenhouse
    ( 2021) Sandro Augusto Magalhães ; Castro,L ; Guilherme Moreira Aresta ; Filipe Neves Santos ; Mário Cunha ; Dias,J ; António Paulo Moreira ; 5157 ; 5552 ; 7481 ; 7332 ; 6321
    The development of robotic solutions for agriculture requires advanced perception capabilities that can work reliably in any crop stage. For example, to automatise the tomato harvesting process in greenhouses, the visual perception system needs to detect the tomato in any life cycle stage (flower to the ripe tomato). The state-of-the-art for visual tomato detection focuses mainly on ripe tomato, which has a distinctive colour from the background. This paper contributes with an annotated visual dataset of green and reddish tomatoes. This kind of dataset is uncommon and not available for research purposes. This will enable further developments in edge artificial intelligence for in situ and in real-time visual tomato detection required for the development of harvesting robots. Considering this dataset, five deep learning models were selected, trained and benchmarked to detect green and reddish tomatoes grown in greenhouses. Considering our robotic platform specifications, only the Single-Shot MultiBox Detector (SSD) and YOLO architectures were considered. The results proved that the system can detect green and reddish tomatoes, even those occluded by leaves. SSD MobileNet v2 had the best performance when compared against SSD Inception v2, SSD ResNet 50, SSD ResNet 101 and YOLOv4 Tiny, reaching an F1-score of 66.15, an mAP of 51.46 and an inference time of 16.44ms with the NVIDIA Turing Architecture platform, an NVIDIA Tesla T4, with 12 GB. YOLOv4 Tiny also had impressive results, mainly concerning inferring times of about 5ms.
  • Item
    Evolution of odometry calibration methods for ground mobile robots
    ( 2020) Ricardo Barbosa Sousa ; Marcelo Petry ; António Paulo Moreira ; 5157 ; 5240 ; 7908
    Localisation is a critical problem in ground mobile robots. For dead reckoning, odometry is usually used. A disadvantage of using it alone is unbounded error accumulation. So, odometry calibration is critical in reducing error propagation. This paper presents an analysis of the developments and advances of systematic methods for odometry calibration. Four steering geometries were analysed, namely differential drive, Ackerman, tricycle and omnidirectional. It highlights the advances made on this field and covers the methods since UMBmark was proposed. The points of analysis are the techniques and test paths used, errors considered in calibration, and experiments made to validate each method. It was obtained fifteen methods for differential drive, three for Ackerman, two for tricycle, and three for the omnidirectional steering geometry. A disparity was noted, compared with the real utilisation, between the number of published works addressing differential drive and tricycle/Ackerman. Still, odometry continues evolving since UMBmark was proposed. © 2020 IEEE.
  • Item
    Extrinsic sensor calibration methods for mobile robots: A short review
    ( 2021) Ricardo Barbosa Sousa ; Marcelo Petry ; António Paulo Moreira ; 5157 ; 5240 ; 7908
    Data acquisition is a critical task for localisation and perception of mobile robots. It is necessary to compute the relative pose between onboard sensors to process the data in a common frame. Thus, extrinsic calibration computes the sensor’s relative pose improving data consistency between them. This paper performs a literature review on extrinsic sensor calibration methods prioritising the most recent ones. The sensors types considered were laser scanners, cameras and IMUs. It was found methods for robot–laser, laser–laser, laser–camera, robot–camera, camera–camera, camera–IMU, IMU–IMU and laser–IMU calibration. The analysed methods allow the full calibration of a sensory system composed of lasers, cameras and IMUs. © The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2021.
  • Item
    Gerber File Parsing for Conversion to Bitmap Image–The VINCI7D Case Study
    ( 2022) Ricardo Barbosa Sousa ; Cláudia Daniela Rocha ; Hélio Mendonça ; António Paulo Moreira ; Manuel Santos Silva ; 1434 ; 5157 ; 5655 ; 6709 ; 7908
  • Item
    Map-Matching Algorithms for Robot Self-Localization: A Comparison Between Perfect Match, Iterative Closest Point and Normal Distributions Transform
    ( 2019) Héber Miguel Sobreira ; António Paulo Moreira ; Paulo José Costa ; Farias,PCMA ; José Lima ; Luís Freitas Rocha ; Sousa,I ; Carlos Miguel Costa ; 6164 ; 5153 ; 5156 ; 5157 ; 5364 ; 5424
    The self-localization of mobile robots in the environment is one of the most fundamental problems in the robotics navigation field. It is a complex and challenging problem due to the high requirements of autonomous mobile vehicles, particularly with regard to the algorithms accuracy, robustness and computational efficiency. In this paper, we present a comparison of three of the most used map-matching algorithms applied in localization based on natural landmarks: our implementation of the Perfect Match (PM) and the Point Cloud Library (PCL) implementation of the Iterative Closest Point (ICP) and the Normal Distribution Transform (NDT). For the purpose of this comparison we have considered a set of representative metrics, such as pose estimation accuracy, computational efficiency, convergence speed, maximum admissible initialization error and robustness to the presence of outliers in the robots sensors data. The test results were retrieved using our ROS natural landmark public dataset, containing several tests with simulated and real sensor data. The performance and robustness of the Perfect Match is highlighted throughout this article and is of paramount importance for real-time embedded systems with limited computing power that require accurate pose estimation and fast reaction times for high speed navigation. Moreover, we added to PCL a new algorithm for performing correspondence estimation using lookup tables that was inspired by the PM approach to solve this problem. This new method for computing the closest map point to a given sensor reading proved to be 40 to 60 times faster than the existing k-d tree approach in PCL and allowed the Iterative Closest Point algorithm to perform point cloud registration 5 to 9 times faster. © 2018 Springer Science+Business Media B.V., part of Springer Nature
  • Item
    Omnidirectional robot modeling and simulation
    ( 2020) Sandro Augusto Magalhães ; António Paulo Moreira ; Paulo José Costa ; 5157 ; 5153 ; 7481
    A robots simulation system is a basis need for any robotics application. With it, developers teams of robots can test their algorithms and make initial calibrations without risk of damage to the real robots, assuring safety. However, build these simulation environments is usually a time-consuming work, and when considering robot fleets, the simulation reveals to be computing expensive. With it, developers building teams of robots can test their algorithms and make initial calibrations without risk of damage to the real robots, assuring safety. An omnidirectional robot from the 5DPO robotics soccer team served to test this approach. The modeling issue was divided into two steps: modeling the motor's non-linear features and modeling the general behavior of the robot. A proper fitting of the robot was reached, considering the velocity robot's response. © 2020 IEEE.
  • Item
    OptiOdom: a Generic Approach for Odometry Calibration of Wheeled Mobile Robots
    ( 2022) Ricardo Barbosa Sousa ; Marcelo Petry ; Paulo José Costa ; António Paulo Moreira ; 5153 ; 5157 ; 5240 ; 7908
    Odometry calibration adjusts the kinematic parameters or directly the robot's model to improve the wheeled odometry accuracy. The existent literature considers in the calibration procedure only one steering geometry (differential drive, Ackerman/tricycle, or omnidirectional). Our method, the OptiOdom calibration algorithm, generalizes the odometry calibration problem. It is developed an optimization-based approach that uses the improved Resilient Propagation without weight-backtracking (iRprop-) for estimating the kinematic parameters using only the position data of the robot. Even though a calibration path is suggested to be used in the calibration procedure, the OptiOdom method is not path-specific. In the experiments performed, the OptiOdom was tested using four different robots on a square, arbitrary, and suggested calibration paths. The OptiTrack motion capture system was used as a ground-truth. Overall, the use of OptiOdom led to improvements in the odometry accuracy (in terms of maximum distance and absolute orientation errors over the path) over the existent literature while being a generalized approach to the odometry calibration problem. The OptiOdom and the methods from the literature implemented in the article are available in GitHub as an open-source repository.
  • Item
    A Pose Control Algorithm for Omnidirectional Robots
    ( 2021) Ricardo Barbosa Sousa ; Costa,PG ; António Paulo Moreira ; 5157 ; 7908
  • Item
    A Survey of high-level teleoperation, monitoring and task assignment to Autonomous Mobile Robots
    ( 2022) Correia,D ; Manuel Santos Silva ; António Paulo Moreira ; 5157 ; 5655
  • Item
    A survey on localization, mapping, and trajectory planning for quadruped robots in vineyards
    ( 2022) Ferreira,J ; António Paulo Moreira ; Manuel Santos Silva ; Filipe Neves Santos ; 5655 ; 5157 ; 5552