基于视触融合的遥操作机器人虚拟环境几何学建模修正方法
DOI:
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP242 TJ765 TH-39

基金项目:

洛阳市重大科技创新专项(2201007A)资助


Geometric modeling and modification method for virtual environment of telerobot based on visual-tactile fusion
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了提高遥操作机器人虚拟环境几何学建模的精度,提出了一种基于视触融合的遥操作机器人虚拟环境几何学建 模修正方法。 首先基于视觉信息通过点云采集和预处理、粗细配准相结合的点云配准、表面重建、位姿测量实现了目标物的 几何学建模;之后针对遥操作机器人的应用背景,设计了局部半自主和多指协同相结合的灵巧手控制方式,完成了目标物触 觉点云的采集;最后采用视触融合的方法,使用 KDtree 将视觉点云和触觉点云进行融合,并利用视触融合点云对几何学模型 进行修正。 通过实验证明该方法对不同材质目标物的几何学建模的几何尺寸误差小于 3. 6 mm、定位误差小于 6. 8 mm、姿态 角测量误差小于 4. 3°,且效果均优于基于视觉信息的几何学模型和基于触觉信息的几何学模型。 该方法构建的几何学模型 既包括了目标物的颜色信息,又提高了几何学模型的精度,且在模型细节处表现良好,有效结合了视觉和触觉两种模态信息 的优点。

    Abstract:

    To improve the accuracy of geometric modeling of the telerobot virtual environment, a method for correcting the geometric modeling of the telerobot virtual environment based on the visual-tactile fusion is proposed. Firstly, based on the visual information, the geometric modeling of the target is realized through point cloud acquisition and preprocessing, point cloud registration combined with thick and thin registration, surface reconstruction and pose measurement. Then, aiming at the application background of telerobot, a dexterous hand control mode combining local semi autonomy and multi finger cooperation is designed to complete the collection of target tactile point cloud. Finally, the visual-tactile fusion method is used to fuse the visual point cloud and the tactile point cloud through KDtree, and the visual-tactile fusion point cloud is used to modify the geometric model. Experiments show that the geometric dimension error of the geometric modeling of the target with different materials by this method is less than 3. 6 mm, the positioning error is less than 6. 8 mm, and the attitude angle measurement error is less than 4. 3°. The effectiveness is better than the geometric model based on visual information and the geometric model based on tactile information. The geometric model constructed by this method not only includes the color information of the target, but also improves the accuracy of the geometric model. It performs well in the details of the model, which effectively combines the advantages of visual and tactile modal information.

    参考文献
    相似文献
    引证文献
引用本文

阳雨妍,宋爱国.基于视触融合的遥操作机器人虚拟环境几何学建模修正方法[J].仪器仪表学报,2023,44(4):101-111

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-07-12
  • 出版日期:
文章二维码