Portal de Periódicos da CAPES

VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW

1993; World Scientific; Linguagem: Inglês

10.1142/9789814503709_0001

1793-0774

Peter Corke,

Teleoperation and Haptic Systems

World Scientific Series in Robotics and Intelligent SystemsVisual Servoing, pp. 1-31 (1993) No AccessVISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEWPeter I. CorkePeter I. CorkeCSIRO Division of Manufacturing Technology, Preston, Victoria, 3072., Australiahttps://doi.org/10.1142/9789814503709_0001Cited by:126 PreviousNext AboutSectionsPDF/EPUB ToolsAdd to favoritesDownload CitationsTrack CitationsRecommend to Library ShareShare onFacebookTwitterLinked InRedditEmail Abstract: This paper attempts to present a comprehensive summary of research results in the use of visual information to control robot manipulators and related mechanisms. An extensive bibliography is provided which also includes important papers from the elemental disciplines upon which visual servoing is based. The research results are discussed in terms of historical context, commonality of function, algorithmic approach and method of implementation. FiguresReferencesRelatedDetailsCited By 126Solution to the problem of designing a safe configuration of a human upper limb robotic prosthesisASh Bureev, EV Golobokova, DS Zhdanov, YV Kosteley and RV Koshelev et al.30 December 2022 | Medicine of Extreme Situations, No. 2022(4)Stability and Convergence Analysis of 3D Feature-Based Visual ServoingMarco Costanzo, Giuseppe De Maria, Ciro Natale and Antonio Russo1 Oct 2022 | IEEE Robotics and Automation Letters, Vol. 7, No. 4RTVS: A Lightweight Differentiable MPC Framework for Real-Time Visual ServoingM. Nomaan Qureshi, Pushkal Katara, Abhinav Gupta, Harit Pandya and Y V S Harish et al.27 Sep 2021Adaptive Real-Time Clustering Method for Dynamic Visual Tracking of Very Flexible WingsTigran Mkhoyan, Coen C. de Visser and Roeland De Breuker1 Feb 2021 | Journal of Aerospace Information Systems, Vol. 18, No. 2Developing the Model Reduction Framework in High Frame Rate Visual Tracking EnvironmentAbdul Rozak Rivai Fassah, Tigran Mkhoyan and Coen C. de Visser4 January 2021Adaptive State Estimation and Real-Time tracking of Aeroelastic Wings with Augmented Kalman filter and Kernelized Correlation FilterTigran Mkhoyan, Coen C. de Visser and Roeland De Breuker4 January 2021Development of Robotic Sorting System for Small Parts Using SCARA RobotKyu Man Shin, Dong Min Lee and Jae Wook Jeon4 Jan 2021Application of Image-Based Visual Servoing on Autonomous DronesTrinadh V S N Venna, Sarosh Patel and Tarek Sobh9 Nov 2020Range Estimation and Visual Servoing of a Dynamic Target using a Monocular CameraRaunak Srivastava, Arnab Maity, Rolif Lima and Kaushik Das1 Sep 2020A Vision-Based Referencing Procedure for Cable-Driven Parallel ManipulatorsMichele Zavatta, Mattia Chianura, Andreas Pott and Marco Carricato6 March 2020 | Journal of Mechanisms and Robotics, Vol. 12, No. 4LyRN (Lyapunov Reaching Network): A Real-Time Closed Loop approach from Monocular VisionZheyu Zhuang, Xin Yu and Robert Mahony1 May 2020Morphology-Agnostic Visual Robotic ControlBrian Yang, Dinesh Jayaraman, Glen Berseth, Alexei Efros and Sergey Levine1 Apr 2020 | IEEE Robotics and Automation Letters, Vol. 5, No. 2Adaptive Real-Time Clustering Method for Dynamic Visual Tracking of Very Flexible WingsTigran Mkhoyan, Coen C. de Visser and Roeland De Breuker5 January 2020Parallel Real-Time Tracking and 3D Reconstruction with TBB for Intelligent Control and Smart Sensing FrameworkTigran Mkhoyan, Coen C. de Visser and Roeland De Breuker5 January 2020Non-linear 3D Visual Control for an Unmanned Aerial VehicleDaniel D. Guevara and Víctor H. Andaluz4 September 2020Learning Real-time Closed Loop Robotic Reaching from Monocular Vision by Exploiting A Control Lyapunov Function StructureZheyu Zhuang, Jurgen Leitner and Robert Mahony1 Nov 2019EMPNet: Neural Localisation and Mapping Using Embedded Memory PointsGil Avraham, Yan Zuo, Thanuja Dharmasiri and Tom Drummond1 Oct 2019Visually Guided Manipulator Based on Artificial Neural NetworksYasaman Ghandi and Mohsen Davoudi15 January 2018 | IETE Journal of Research, Vol. 65, No. 2Deployment of an autonomous mobile manipulator at MBZIRCJan Carius, Martin Wermelinger, Balasubramanian Rajasekaran, Kai Holtmann and Marco Hutter27 October 2018 | Journal of Field Robotics, Vol. 35, No. 8Image Based Visual Servoing for Tumbling ObjectsP Mithun, Harit Pandya, Ayush Gaud, Suril V. Shah and K. Madhava Krishna1 Oct 2018Multi-criteria fuzzy decision support for conceptual evaluation in design of mechatronic systems: a quadrotor design case studyAbolfazl Mohebbi, Sofiane Achiche and Luc Baron17 April 2018 | Research in Engineering Design, Vol. 29, No. 3Mobile Robot Control and Navigation: A Global OverviewSpyros G. Tzafestas10 March 2018 | Journal of Intelligent & Robotic Systems, Vol. 91, No. 1Deep Forward and Inverse Perceptual Models for Tracking and PredictionAlexander Lambert, Amirreza Shaban, Amit Raj, Zhen Liu and Byron Boots1 May 2018Monocular visual pose estimation via online sampling for Mars sample-tube pickupBhoram Lee, Renaud Detry, Jasmine Moreno, Daniel D. Lee and Eric Kulczycki1 Mar 2018An Autonomous Dynamic Camera Method for Effective Remote TeleoperationDaniel Rakita, Bilge Mutlu and Michael Gleicher26 February 2018Autonomous Mission with a Mobile Manipulator—A Solution to the MBZIRCJan Carius, Martin Wermelinger, Balasubramanian Rajasekaran, Kai Holtmann and Marco Hutter3 November 2017A machine learning-based visual servoing approach for fast robot control in industrial settingFrancesco Castelli, Stefano Michieletto, Stefano Ghidoni and Enrico Pagello9 November 2017 | International Journal of Advanced Robotic Systems, Vol. 14, No. 6Flexible robotic grasping strategy with constrained region in environmentChao Ma, Hong Qiao, Rui Li and Xiao-Qing Li4 July 2017 | International Journal of Automation and Computing, Vol. 14, No. 5A method for hand-eye and camera-to-camera calibration for limited fields of viewChristian Nissler, Zoltan-Csaba Marton, Hannes Kisner, Ulrike Thomas and Rudolph Triebel1 Sep 2017How to achieve precise operation of a robotic manipulator on a macro to micro/nano scaleZhiqiang Yu, Qing Shi, Huaping Wang, Ning Yu and Qiang Huang et al.3 Apr 2017 | Assembly Automation, Vol. 37, No. 2Robot-to-Camera Calibration: A Generic Approach Using 6D DetectionsChristian Nissler and Zoltan-Csaba Marton1 Apr 2017Integration of Visual and Joint Information to Enable Linear Reaching MotionsHenry Eberle, Slawomir J. Nasuto and Yoshikatsu Hayashi19 January 2017 | Scientific Reports, Vol. 7, No. 1Fiducial Markers Applied for Pose Tracking of a Robotic Manipulator: Application in Visual Servoing ControlIgor Pereira Vieira, Armando Alves Neto and Leonardo Amaral Mozelli1 Oct 2016Low-latency heading feedback control with neuromorphic vision sensors using efficient approximated incremental inferenceErich Mueller, Andrea Censi and Emilio Frazzoli1 Dec 2015Efficient high speed signal estimation with neuromorphic vision sensorsErich Mueller, Andrea Censi and Emilio Frazzoli1 Jun 2015Mobile robot arm trajectory generation for operation in confined environmentsDavid Galvão Wall, John Economou, Hugh Goyder, K Knowles and Peter Silson et al.5 December 2014 | Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, Vol. 229, No. 3A Visual Servoing System for Interactive Human-Robot Object TransferYing Wang, Daniel Ewert, Rene Vossen and Sabina Jeschke1 Jan 2015 | Journal of Automation and Control Engineering, Vol. 2A visual guided robot using CAD models and fuzzy controller for industrial manipulationChing-Chang Chen, Chun-Ming Wen, Chia-Yu Eric Wang and Yi-Cheng Chen1 Nov 2014Direct Motion Planning for Vision-Based ControlRoel Pieters, Zhenyu Ye, Pieter Jonker and Henk Nijmeijer1 Oct 2014 | IEEE Transactions on Automation Science and Engineering, Vol. 11, No. 4Visual servoing in medical robotics: a survey. Part I: endoscopic and direct vision imaging - techniques and applicationsMahdi Azizian, Mahta Khoshnam, Nima Najmaei and Rajni V. Patel18 September 2013 | The International Journal of Medical Robotics and Computer Assisted Surgery, Vol. 10, No. 3Iterative Learning Control for image based visual servoing applicationsErick Sutanto and Andrew G. Alleyne1 Jun 2014Visión artificial y Filtro de Kalman aplicados al control de un péndulo invertidoDamian A. Garayalde and Pablo Negri1 Jun 2014Controlled robotic cell using visual servoingI. Elizondo Aguilera, O. Felix Beltran, J. Cid Monjaraz, F. Reyes Cortes and L. C. Gomez Pavon et al.1 Apr 2014A mini work-cell for handling and assembling microcomponentsGianmauro Fontana, Serena Ruggeri, Irene Fassi and Giovanni Legnani28 Jan 2014 | Assembly Automation, Vol. 34, No. 1Development and experiment of CSM-based industrial robot servoing control systemYong Liu, Dingbing Shi, Steven B. Skaar and Jindong Tan1 May 2013Experiments Comparing Precision of Stereo-Vision Approaches for Control of an Industrial ManipulatorJohn-David Yoder, Jeffrey West, Eric Baumgartner, Mathias Perrollaz and Michael Seelinger et al.1 Jan 2013A reflected laser line approach for industrial robot calibrationErick Nieves, Ning Xi, Biqiang Du and Yunyi Jia1 Jul 2012Multiple plane tracking using Unscented Kalman FilterVisesh Chari and C V Jawahar1 Oct 2010High performance visual servoing for controlled µm-positioningRoel Pieters, Pieter Jonker and Henk Nijmeijer1 Jul 2010Camera-Based Control for Industrial Robots Using OpenCV LibrariesPatrick A. Seidel and Kay Böhnke1 Jan 2010A new control scheme for visual servoingLuis Gracia and Carlos Perez-Vidal8 October 2009 | International Journal of Control, Automation and Systems, Vol. 7, No. 5Visual Servoing Controller for Robot ManipulatorsJaime Cid M and Fernando Reyes C.1 Feb 2009Visual feedback control for endoscopes using tension estimation Kazuyuki Gotoh and Akira Shimada1 Mar 2008Object manipulation of a humanoid robot based on visual ServoingYunting Pang, Qiang Huang, Dongyong Jia, Ye Tian and Junyao Gao et al.1 Oct 2007An Automated Camera Orientation Recovery Algorithm for an Eye-in-hand Robotic ManipulatorSebastian van Delden, Ricky Farr and Seth Hensley1 Oct 2007Robot grasping of unknown objects, description and validation of the function with quadriplegic peopleChristophe Leroux, Isabelle Laffont, Nicolas Biard, Sophie Schmutz and Jean Francois Desert et al.1 Jun 2007Dynamic Active Contours for Visual TrackingM. Niethammer, A. Tannenbaum and S. Angenent1 Apr 2006 | IEEE Transactions on Automatic Control, Vol. 51, No. 4Collaborative Control of the Manus ManipulatorB. J. F. Driessen, T. K. Ten. Kate, F. Liefhebber, A. H. G. Versluis and J. A. van. Woerden8 November 2005 | Universal Access in the Information Society, Vol. 4, No. 2Teach by Zooming Visual Servo Control for an Uncalibrated Camera SystemSiddhartha Mehta, Warren Dixon, Thomas Burks and Sumit Gupta19 June 2005Color-based visual servoing under varying illumination conditionsGeert De Cubber, Sid Ahmed Berrabah and Hichem Sahli1 Jul 2004 | Robotics and Autonomous Systems, Vol. 47, No. 4Attentional sequence-based recognition: markovian and evidential reasoningC. Soyer, H.I. Bozma and Y. Istefanopulos1 Dec 2003 | IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), Vol. 33, No. 6Performance Tests for Visual Servo Control Systems, with Application to Partitioned Approaches to Visual Servo ControlNicholas R. Gans, Seth A. Hutchinson and Peter I. Corke2 July 2016 | The International Journal of Robotics Research, Vol. 22, No. 10-11A Calibration-Free Robot System Via the Simultaneous Perturbation MethodMasahiro Suginaka and Yutaka Maeda1 Jan 2003 | IEEJ Transactions on Electronics, Information and Systems, Vol. 123, No. 9Visual Servoing from LinesNicolas Andreff, Bernard Espiau and Radu Horaud2 July 2016 | The International Journal of Robotics Research, Vol. 21, No. 8Hardware Experiments of a Truss Assembly by an Autonomous Space Learning RobotKei Senda, Yoshisada Murotsu, Akira Mitsuya, Hirokazu Adachi and Shin'ichi Ito et al.1 Mar 2002 | Journal of Spacecraft and Rockets, Vol. 39, No. 2A guidance-assistance system for agricultural vehiclesC. Debain, T. Chateau, M. Berducat, P. Martinet and P. Bonton1 Jan 2000 | Computers and Electronics in Agriculture, Vol. 25, No. 1-2On the use of linear camera-object interaction models in visual servoingB. Allotta and C. Colombo1 Apr 1999 | IEEE Transactions on Robotics and Automation, Vol. 15, No. 2A Hierarchical Vision Architecture for Robotic Manipulation TasksZachary Dodds, Martin Jägersand, Greg Hager and Kentaro Toyama24 September 2002Combining Visual, Tactile and Range Sensor Information to Increase the Autonomy of RobotsM. Seitz, A. Weigl, K. Hohm and K. Kleinmann1 Jan 1999Visual servoing and CAD-driven microassemblyJ.T. Feddema and R.W. Simon1 Dec 1998 | IEEE Robotics & Automation Magazine, Vol. 5, No. 4Adaptive hybrid control for visual and force servoing in an unknown environmentK. Hosoda, K. Igarashi and M. Asada1 Dec 1998 | IEEE Robotics & Automation Magazine, Vol. 5, No. 4Visually guided object graspingR. Horaud, F. Dornaika and B. Espiau1 Aug 1998 | IEEE Transactions on Robotics and Automation, Vol. 14, No. 4Coordinating the eyes, head and arm of an autonomous robotYau Wei-Yun and Wang Han1 Apr 1998 | Engineering Applications of Artificial Intelligence, Vol. 11, No. 2Adaptive visual servoing for various kinds of robot systemsKoh Hosoda and Minoru Asada1 December 2007Efficient Learning of VAM-Based Representation of 3D Targets and its Active Vision ApplicationsNarayan Srinivasa and Rajeev Sharma1 Jan 1998 | Neural Networks, Vol. 11, No. 1Motion perceptibility and its application to active vision-based servo controlR. Sharma and S. Hutchinson1 Aug 1997 | IEEE Transactions on Robotics and Automation, Vol. 13, No. 4SOIM: a self-organizing invertible map with applications in active visionN. Srinivasa and R. Sharma1 May 1997 | IEEE Transactions on Neural Networks, Vol. 8, No. 3A framework for robot motion planning with sensor constraintsR. Sharma and H. Sutanto1 Feb 1997 | IEEE Transactions on Robotics and Automation, Vol. 13, No. 1A tutorial on visual servo controlS. Hutchinson, G.D. Hager and P.I. Corke1 Oct 1996 | IEEE Transactions on Robotics and Automation, Vol. 12, No. 5Dynamic effects in visual closed-loop systemsP.I. Corke and M.C. Good1 Oct 1996 | IEEE Transactions on Robotics and Automation, Vol. 12, No. 5Relative end-effector control using Cartesian position based visual servoingW.J. Wilson, C.C. Williams Hulls and G.S. Bell1 Oct 1996 | IEEE Transactions on Robotics and Automation, Vol. 12, No. 5Force and vision resolvability for assimilating disparate sensory feedbackB.J. Nelson and P.K. Khosla1 Oct 1996 | IEEE Transactions on Robotics and Automation, Vol. 12, No. 5Measurement and storage of a network of jacobians as a method for the visual positioning of a robot armJuan Domingo and Joan Pelechano1 Aug 1996 | Journal of Intelligent and Robotic Systems, Vol. 16, No. 4An extendable framework for expectation-based visual servoing using environment modelsB.J. Nelson and P.K. Khosla1 Jan 1995Integrating grasp planning and visual servoing for automatic graspingRadu Horaud, Fadi Dornaika, Christian Bard and Christian LaugierRole of active vision in optimizing visual feedback for robot controlRajeev SharmaAn alternative approach for image-plane control of robotsMichael Seelinger, Steven B. Skaar and Matthew RobinsonWhat can be done with an uncalibrated stereo system?João Hespanha, Zachary Dodds, Gregory D. Hager and A. S. MorseVisual servoing with independently controlled cameras using a learned invariant representationR. SharmaVisual servoing for automatic and uncalibrated needle placement for percutaneous proceduresN. Navab, B. Bascle, M. Loser, B. Geiger and R. TaylorApplication of piezo-driven polymer microgripper in automatic transportation of micro object Ren Jung Chang, Po Wei Shih, Ren Zuo Huang and Kuan Yan LinResearch of real time robot visual servoing based on genetic algorithm Han Liu, Ding Liu and Yan-Xi YangCanonical decomposition of affine motion for visual servoingM. Wong and R. EaglesonAn experimental visual feedback control system for tracking applications using a robotic manipulatorJ.A. Akec, S.J. Steiner and F. StengerSegmentation of surgical needles for fluoroscopy servoing using the insight software toolkit (ITK)K. Cleary, L. Ibanez, N. Navab, D. Stoianovici and A. Patriciu et al.Versatile visual servoing without knowledge of true JacobianK. Hosoda and M. AsadaTrajectory generation for obstacle avoidance of uncalibrated stereo visual servoing without 3D reconstructionK. Hosoda, K. Sakamoto and M. AsadaFast stable contact transitions with a stiff manipulator using force and vision feedbackB.J. Nelson, J.D. Morrow and P.K. KhoslaAdaptive hybrid visual servoing/force control in unknown environmentK. Hosoda, K. Igarashi and M. AsadaAdaptive visual servoing for legged robots-vision-cued swaying of legged robots in unknown environmentsK. Hosoda, T. Miyashita, S. Takeuchi and M. AsadaVisual determination of 3D grasping points on unknown objects with a binocular camera systemA. Hauck, J. Ruttinger, M. Sorg and G. FarberPosition based visual servoing using a non-linear approachP. Martinet and J. GalliceVisual servoing based on object motion estimationK. Nagahama, K. Hashimoto, T. Noritsugu and M. TakaiawaA camera independent alternative to teach by showing visual servo controlW.E. DixonA biologically motivated model for the control of visually guided reach-to-grasp movementsA. Hauck, M. Sorg, G. Farber and T. SchenkAn experimental study of predictors for visual servoingR. Garrido, E. Gonzblez, A. Carvallo and E. GortchevaVision based position control of a robot manipulator using wavelet based feature extraction Kwang-Ho Park, Hwan-Jin Cho, Chang-Doo Kee and Sang-Hwa JeongNeedle placement under X-ray fluoroscopy using perspective invariantsB. Bascle, N. Navab, M. Loser, B. Geiger and R. TaylorOptimizing hand/eye configuration for visual-servo systemsR. Sharma and S. HutchinsonVisual servoing utilizing zoom mechanismK. Hosoda, H. Moriyama and M. AsadaA framework for robot control with active vision using a neural network based spatial representationR. Sharma and N. SrinivasaUnifying configuration space and sensor space for vision-based motion planningR. Sharma and H. SutantoVision-based servoing control for legged robotsK. Hosoda, M. Kamado and M. AsadaImage based autodocking without calibrationH. Sutanto, R. Sharma and V. VarmaApproximate reasoning for the control of a robot in an uncertain environment: a multi-model approachL. Dubois, T. Fukuda, F. Delmotte and P. BorneSelection of image features for robot positioning using mutual informationG. Wells and C. TorrasVision-guided grasping of unknown objects for service robotsP.J. Sanz, A.P. Del Pobil, J.M. Inesta and G. RecatalaPerformance of a partitioned visual feedback controllerP.Y. Oh and P.K. AllenWhat can be learned from human reach-to-grasp movements for the design of robotic hand-eye systems?A. Hauck, M. Sorg, G. Farber and T. SchenkAutomatic segmentation and matching of planar contours for visual servoingG. Chesi, E. Malis and R. CipollaRotation-oriented visual servoing based on cylindrical coordinatesM. Iwatsuki and N. OkiyamaPerceptual navigation strategy for mobile robots intercepting ground balls Zheng Wang, A. Paranjape, T. Sugar and M. McBeathResolved velocity controller with an online RBF-NN compensator for controlling a dynamic binocular active vision headS. Kumarawadu, K. Watanabe, K. Kiguchi and K. IzumiVisual-servoing and navigation of mobile robots for target tracking applicationsS. Rangavajhala and A. ShirkhodaieCooperative visual team working and target tracking of mobile robotsM.K. Hajjawi and A. ShirkhodaieStructured lighting to enhance global image feature sensitivity in a neural network based robot-positioning taskM. Hatano, T. Ohsumi, M. Minami and T. Asakura Visual ServoingMetrics History PDF download