ass日本风韵熟妇pics男人扒开女人屁屁桶到爽|扒开胸露出奶头亲吻视频|邻居少妇的诱惑|人人妻在线播放|日日摸夜夜摸狠狠摸婷婷|制服 丝袜 人妻|激情熟妇中文字幕|看黄色欧美特一级|日本av人妻系列|高潮对白av,丰满岳妇乱熟妇之荡,日本丰满熟妇乱又伦,日韩欧美一区二区三区在线

基于實(shí)例分割的番茄串視覺定位與采摘姿態(tài)估算方法
CSTR:
作者:
作者單位:

作者簡介:

通訊作者:

中圖分類號(hào):

基金項(xiàng)目:

廣東省現(xiàn)代農(nóng)業(yè)產(chǎn)業(yè)共性關(guān)鍵技術(shù)研發(fā)創(chuàng)新團(tuán)隊(duì)建設(shè)項(xiàng)目(2019KJ129)


Visual Positioning and Picking Pose Estimation of Tomato Clusters Based on Instance Segmentation
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 圖/表
  • |
  • 訪問統(tǒng)計(jì)
  • |
  • 參考文獻(xiàn)
  • |
  • 相似文獻(xiàn)
  • |
  • 引證文獻(xiàn)
  • |
  • 資源附件
  • |
  • 文章評(píng)論
    摘要:

    準(zhǔn)確識(shí)別定位采摘點(diǎn),,根據(jù)果梗方向,,確定合適的采摘姿態(tài),是機(jī)器人實(shí)現(xiàn)高效,、無損采摘的關(guān)鍵,。由于番茄串的采摘背景復(fù)雜,果實(shí)顏色,、形狀各異,,果梗姿態(tài)多樣,葉子藤枝干擾等因素,,降低了采摘點(diǎn)識(shí)別準(zhǔn)確率和采摘成功率,。針對(duì)這個(gè)問題,考慮番茄串生長特性,提出基于實(shí)例分割的番茄串視覺定位與采摘姿態(tài)估算方法,。首先基于YOLACT實(shí)例分割算法的實(shí)例特征標(biāo)準(zhǔn)化和掩膜評(píng)分機(jī)制,,保證番茄串和果梗感興趣區(qū)域 (Region of interest, ROI)、掩膜質(zhì)量和可靠性,,實(shí)現(xiàn)果梗粗分割,;通過果梗掩膜信息和ROI位置關(guān)系匹配可采摘果梗,基于細(xì)化算法,、膨脹操作和果梗形態(tài)特征實(shí)現(xiàn)果梗精細(xì)分割,;再通過果梗深度信息填補(bǔ)法與深度信息融合,精確定位采摘點(diǎn)坐標(biāo),。然后利用果梗幾何特征,、八鄰域端點(diǎn)檢測(cè)算法識(shí)別果梗關(guān)鍵點(diǎn)預(yù)測(cè)果梗姿態(tài),并根據(jù)果梗姿態(tài)確定適合采摘的末端執(zhí)行器姿態(tài),,引導(dǎo)機(jī)械臂完成采摘,。研究和大量現(xiàn)場(chǎng)試驗(yàn)結(jié)果表明,提出的方法在復(fù)雜采摘環(huán)境中具有較高的定位精度和穩(wěn)定性,,對(duì)4個(gè)品種的番茄串采摘點(diǎn)平均識(shí)別成功率為98.07%,,圖像分辨率為1280像素×720像素時(shí)算法處理速率達(dá)到21f/s,采摘點(diǎn)圖像坐標(biāo)最大定位誤差為3像素,,深度誤差±4mm,,成功定位采摘點(diǎn)后采摘成功率為98.15%。與現(xiàn)有的同類方法相比,,采摘點(diǎn)圖像坐標(biāo)定位精度提高76.80個(gè)百分點(diǎn),,采摘成功率提高15.17個(gè)百分點(diǎn),采摘效率提高31.18個(gè)百分點(diǎn),,滿足非結(jié)構(gòu)化種植環(huán)境中番茄串采摘需求,。

    Abstract:

    Recognizing and positioning the picking points (spatial position and coordinate points), and determining the appropriate picking pose according to the direction of fruit stem, are the keys for the robot to achieve efficient and lossless picking during harvesting. However, the harvesting environment is complex and changeable, the color of fruit stem is similar to the branches and leaves, and the tomato clusters are always with different colors and shapes. Furthermore, tomato clusters grow in different directions, and the end effector frequently interferes with the leaves and vine during picking, there are often situations of “not picking when robot see it”, which reduces the recognition accuracy of picking points and picking rate. Aiming at this problem, considering the growth characteristics of tomato clusters, a method for visual positioning and picking pose estimation of tomato clusters based on instance segmentation was proposed. Firstly, based on the instance feature standardization, and the mask scoring mechanism of the YOLACT algorithm, the high quality and reliable region of interest (ROIs) and masks of tomato clusters were collected. Specifically, in order to efficiently achieve the coarse segmentation of fruit stems via the YOLACT. Then, according to the stem mask information and the neighbor relationship between tomato ROIs and stem ROIs, the ROIs of pickable stems were determined. Meanwhile, the pickable stem edges were finely extracted from the stem ROI by using the thinning algorithm, together with expansion operation and shape characteristics of stem. Secondly, the picking point in image coordinate system was obtained, which was set as the center point of stem skeleton along the X (or Y) axis. Subsequently, the depth map of pickable stem ROI was used for obtaining the original depth value of picking point. Specifically, due to the large depth value errors, or even a lack of depth values when capturing small objects by the economical RGB-D depth camera. By using only the depth map corresponding to the stem mask area, the average depth value of picking point was calculated. The accurate depth value of picking point was obtained by comparing the average with the original depth value. Thirdly, according to the geometric features of fruit stem, the tangent slope of fruit stem at the picking point was calculated, and the search algorithm was used for finding the endpoints of fruit stem. Correspondingly, fruit stem direction was estimated by the vector composed of two endpoints of fruit stem. Finally, the picking point was converted to the robot coordinate system. Simultaneously, according to the tangent slope and the direction of fruit stem, the picking pose of the end effector was determined. Eventually, the robot was guided to complete the picking task with an appropriate pose. A large number of field test verified that the average recognition rate of pickings point was 98.07%, while the image resolution was 1280 pixel×720 pixel, the processing rate of the algorithm was 21f/s, the maximum positioning error of the image coordinates of picking points was 3 pixels, and the depth value error was ±4mm. After the picking points were successfully positioned, the picking rate was 98.15%. Compared with the existing similar methods, the positioning accuracy of the picking point was increased by 76.80 percentage points, the picking rate was increased by 15.17 percentage points, and picking efficiency was increased by 31.18 percentage points. Therefore, the proposed method fully met the requirements for robots in unstructured environment during harvesting.

    參考文獻(xiàn)
    相似文獻(xiàn)
    引證文獻(xiàn)
引用本文

張勤,龐月生,李彬.基于實(shí)例分割的番茄串視覺定位與采摘姿態(tài)估算方法[J].農(nóng)業(yè)機(jī)械學(xué)報(bào),2023,54(10):205-215. ZHANG Qin, PANG Yuesheng, LI Bin. Visual Positioning and Picking Pose Estimation of Tomato Clusters Based on Instance Segmentation[J]. Transactions of the Chinese Society for Agricultural Machinery,2023,54(10):205-215.

復(fù)制
分享
文章指標(biāo)
  • 點(diǎn)擊次數(shù):
  • 下載次數(shù):
  • HTML閱讀次數(shù):
  • 引用次數(shù):
歷史
  • 收稿日期:2023-04-08
  • 最后修改日期:
  • 錄用日期:
  • 在線發(fā)布日期: 2023-05-03
  • 出版日期:
文章二維碼