机械臂倒液任务中透明容器的液位高度视觉检测与控制
DOI:
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP242. 6 TH741

基金项目:

科技部科技创新 2030“新一代人工智能”重大项目(2020AAA0107300)资助


Visual detection and control for liquid level height of transparent containers in robotic pouring
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对包含多类透明容器与多种液体的机械臂倒液任务,提出了一种不需要相机标定与标尺辅助的液位相对高度视觉检 测方法与闭环控制方案。 首先,分析了服务机器人倒液任务的特点,使用计算机视觉中的目标检测方法同时检测液体与容器, 利用液体与容器的高度比例关系得到相对液位高度,避免了测量液位绝对高度所需的繁杂标定过程。 其次,利用小孔成像模型 对所提的相对液位高度检测方案进行几何建模与分析,推理出典型情形下测量的误差规律;再次,采集多种液体、多类容器的图 像作为训练集来训练 YOLOv5s,用于检测目标物以获得液位相对高度。 测试结果验证了所提的液位检测方法的有效性,新方法 对于训练集中未出现的新形状容器中的新液体的平均配对检出精度为 86. 7% ;最后,为了避免求解或估计视觉伺服理论中复杂 的雅可比矩阵,将求得的相对液位高度与 PD 控制结合组成液位闭环控制系统。 系统使用相同的 PD 控制器参数在两种倒液平 台上的多类倒液任务中均取得成功,验证了液位闭环控制方案的有效性与鲁棒性。

    Abstract:

    A visual detection method of relative liquid level without camera calibration and liquid level gauge and closed-loop control system are proposed for the robotic pouring task related to multiple types of transparent containers and liquids. Firstly, the characteristics of the service robots′ liquid pouring tasks are analyzed and the target detection method in computer vision field is deployed to detect liquids and containers simultaneously. The relative liquid level height is obtained by calculating the height-proportion between the detected container and detected liquid, which avoids the complicated hand-eye calibration processes during the measurement of liquid level′s absolute height. Secondly, the proposed liquid level detection method is geometrically modeled and analyzed by applying the pinhole imaging model, and the laws on measurement errors of relative liquid level height are deduced in typical cases. Thirdly, the images of various liquids and containers are collected to train YOLOv5s, which is deployed to detect target object and obtain the relative height of liquid level. The test results verify the effectiveness of proposed method. The paired average precision of new method is 86. 7% for the new types of liquids in new shaped containers that do not appear in the training set. Finally, to avoid solving or estimating corresponding Jacobian matrices in visual servo theory, the detected liquid level height is combined with PD control to get a closed-loop control system. Several kinds of liquid pouring tasks on both manipulator platforms are successful with the same parameters in PD controller, which prove the effectiveness and robustness of proposed closed-loop control method.

    参考文献
    相似文献
    引证文献
引用本文

朱美强,汤力凡,王鸿璞,李 明,王 军.机械臂倒液任务中透明容器的液位高度视觉检测与控制[J].仪器仪表学报,2023,44(10):283-293

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-01-25
  • 出版日期:
文章二维码