Skip to main contentSkip to article

• Journals & Books

• Help

• Search

My account

Sign in

Smart Agricultural Technology

Date:Available online 26 October 2026

Article:102673

In Press, Journal Pre-proof

View accessibility information

Published by:Elsevier

Published by

Show more

Review article

Open access

Under a Creative Commons license

Get rights and content

Machine Vision for Fruit Detection and Localization in Intelligent Harvesting Robots: A Comprehensive Review

Author links open overlay panel Liujing Yu a, Yingjun Pu a, Ju Lin a, Mustafa Mhamed b, Reza Ehsani c, Cheng Shen d, Fuzeng Yang e

Show more

ViewPDF

Cite

Add to Mendeley

Share

10.1016/j.atech.2026.102673

More actions

• Article

Abstract

Autonomous fruit harvesting requires not only accurate fruit detection but also the reliable transformation of uncertain visual observations into safe, efficient, and low-damage robotic harvesting actions. Achieving this objective remains challenging in commercial orchards because variable illumination, severe fruit occlusion, plant motion, and constrained workspaces introduce substantial uncertainty into both visual perception and robotic execution. In this review, we systematically synthesize recent advances in machine vision for fruit detection, segmentation, three-dimensional localization, pose estimation, and picking-point localization, and examine their integration with end-effector operation and hand–eye coordination in intelligent harvesting robots. We compare eye-in-hand, eye-to-hand, and hybrid vision configurations; two-dimensional and three-dimensional sensing modalities; machine-learning-, deep-learning-, and Transformer-based perception methods; and representative harvesting-system configurations. This review establishes an integrated perspective on the interactions among sensing, perception, motion planning, grasping, detachment, and feedback within a perception–action–interaction cycle. It highlights the transition from object-oriented detection to operation-oriented perception, which involves not only understanding the fruit position but also the attachment structure, approach direction, obstacles, interaction risk, and harvestability. There are several challenges to deployment in complex field conditions, including calibration drift, incomplete spatial information, limited end-effector adaptability, and accumulated perception-execution errors. Future harvesting systems will need to integrate multimodal sensing, active view planning, uncertainty-aware decision-making, visual servoing, and tactile-force feedback to enable autonomous fruit harvesting to be scalable and damage-aware.

Keywords

Fruit-harvesting robots

;

Machine vision

;

Fruit detection

;

Pose estimation

;

Picking-point localization

;

Hand-eye coordination

Sorry, something went wrong. Please try again and make sure cookies are enabled

Data availability

Data will be made available on request.

Recommended articles

Recommended articles cannot be displayed at this time.

© 2026 Published by Elsevier B.V.

• About ScienceDirect
• Remote access
• Contact and support
• Terms and conditions
• Privacy policy
• Cookie settings

All content on this site: Copyright © 2026 Elsevier B.V., its licensors, and contributors. All rights are reserved, including those for text and data mining, AI training, and similar technologies. For all open access content, the relevant licensing terms apply.

Persistent link using digital object identifier (DOI)

We use cookies that are necessary to make our site work. We may also use additional cookies to analyze, improve, and personalize our content and your digital experience. You can manage your cookie preferences using theCookie settings link. For more information, see ourCookie Policy

Cookie settings Accept all cookies

Opt-Out Request Honored

Cookie Preference Center

We use cookies which are necessary to make our site work. We may also use additional cookies to analyse, improve and personalise our content and your digital experience. For more information, see our Cookie Policy and the list of Google Ad-Tech Vendors.

You may choose not to allow some types of cookies. However, blocking some types may impact your experience of our site and the services we are able to offer. See the different category headings below to find out more or change your settings.

You may also be able to exercise your privacy choices as described in our Privacy Policy

Allow all

Manage Consent Preferences

Strictly Necessary Cookies

Always active

These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.

Cookie Details List

Functional Cookies

• [x] Functional Cookies

These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.

Cookie Details List

Performance Cookies

• [x] Performance Cookies

These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site.

Cookie Details List

Contextual Advertising Cookies

• [x] Contextual Advertising Cookies

These cookies are used for properly showing banner advertisements on our site and associated functions such as limiting the number of times ads are shown to each user.

Cookie Details List

Cookie List

Clear

• • [x] checkbox label label

Apply Cancel

Consent Leg.Interest

• [x] checkbox label label

• [x] checkbox label label

• [x] checkbox label label

Confirm my choices