百科.dev
全部条目AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
V

vision-based-robotic-grasping

> 编程语言
开源

基于视觉的机器人抓取相关论文和代码

1.5K stars0 点赞0 次浏览
访问官网GitHub

工具介绍

基于视觉的机器人抓取相关论文和代码

Vision-based Robotic Grasping: Papers and Codes

The essential information to grasp the target object is the 6D gripper pose in the camera coordinate, which contains the 3D gripper position and the 3D gripper orientation to execute the grasp. Within the methods of vision-based robotic grasping, the estimation of 6D gripper poses varies aiming at different grasp manners, which can be categorized into 2D planar grasp and 6DoF grasp.

2D planar grasp means that the target object lies on a plane workspace and the grasp is constrained from one direction. The essential information is simplified from 6D into 3D, which are the 2D in-plane positions and 1D rotation angle. There exist methods of evaluating grasp contact points and methods of evaluating grasp oriented rectangles.

6DoF grasp means that the gripper can grasp the object from various angles in the 3D domain, and the essential 6D gripper pose could not be simplified. Based on whether the grasp is conducted on the complete shape or on the single-view point cloud, methods are categorized into methods based on the partial point cloud and methods based on the complete shape. Methods based on the partial point cloud contains methods of estimating candidate grasps and methods of transferring grasps from existing grasps database. Methods based on the complete shape contains methods of estimating 6D object pose and methods of shape completion. Most of current 6DoF grasp methods aim at known objects where the grasps could be precomputed manually or by simulation, and the problem is thus transformed into a 6D object pose estimation problem.

Besides, most of the robotic grasping approaches require the target object’s location in the input data first. This involves three different stages: object localization without classification, object detection and object instance segmentation. Object localization without classification only outputs the potential regions of the target objects without knowing their categories. Object detection provides bounding boxes of the target objects with their categories. Object instance segmentation further provides pixel or point-level regions of the target objects with their categories.

I summarize all above kinds of methods in this repository, and hope to present a big picture for friends work on vision-based robotic grasping. The table of content is listed as follows.

Thank Hatim Wen for modifying all links to the pdf files and writing a convenient program to download the papers.

How to use?

  1. run python download.py to start your download process.

NOTE:

Before you use, it's better read and change the codes.

Specifically, you should change the value of `name` in  `download.py`(line 18) into the md file you split, e.g. '6DoF Grasp.md'.
  • Vision-based Robotic Grasping: Papers and Codes
  • 0. Review Papers
  • 1. Object Localization
    • 1.1 Object Localization without Classification
      • 1.1.1 2D-based Methods
        • a. Fitting 2D Shape Primitives
        • b. Saliency Detection
      • 1.1.2 3D-based Methods
        • a. Fitting 3D Shape Primitives
        • b. Saliency Detection
    • 1.2 Object Detection
      • 1.2.1 2D Object Detection
        • a. Two-stage methods
        • b. Single-stage methods
      • 1.2.2 3D Object Detection
        • a. RGB-based methods
        • b. Point cloud-based methods
        • c. Fusion methods
    • 1.3 Object Instance Segmentation
      • 1.3.1 2D Instance Segmentation
        • a. Survey papers
        • b. Two-stage methods
        • c. One-stage methods
        • d. Panoptic segmentation
      • 1.3.2 3D Instance Segmentation
        • a. Two-stage methods
        • b. One-stage Methods
        • c. 3D deep learning networks
  • 2. Object Pose Estimation
    • 2.1 RGB-D Image-based Methods
      • 2.1.1 Correspondence-based Methods
        • a. Match 2D feature points
        • b. Regress 2D projections
      • 2.1.2 Template-based Methods
      • 2.1.3 Voting-based Methods
    • 2.2 Point Cloud-based Methods
      • 2.2.1 Correspondence-based Methods
      • 2.2.2 Template-based Methods
      • 2.2.3 Voting-based Methods
    • 2.3 Category-level Methods
      • 2.3.1 Category-level 6D pose estimation
      • 2.3.2 3D shape reconstruction from images
      • 2.3.3 3D shape rendering
  • 3. 2D Planar Grasp
    • 3.1 Estimating Grasp Contact Points
    • 3.2 Estimating Oriented Rectangles
  • 4. 6DoF Grasp
    • 4.1 Methods based on Single-view Point Cloud
      • 4.1.1 Methods of Estimating Candidate Grasps
      • 4.1.2 Methods of Transferring Grasps
        • a. Grasp transfer
        • b. Non-rigid registration
        • c. Shape correspondence
    • 4.2 Methods based on Complete Shape
      • 4.2.1 Methods of Estimating 6D Object Pose
      • 4.2.2 Methods of Shape Completion
        • a. Shape Completion-based Grasp
        • b. Shape Completion or Generation
        • c. Depth Completion and Estimation
        • d. Point Cloud Denoising and Samping
  • 5. Task-oriented Methods
    • 5.1 Task-oriented Manipulation
    • 5.2 Grasp Affordance
    • 5.3 3D Part Segmentation
  • 6. Dexterous Grippers
  • 7. Data Generation
    • 7.1 Simulation to Reality
    • 7.2 Self-supervised Methods
  • 8. Multi-source
  • 9. Motion Planning
    • 9.1 Visual servoing
    • 9.2 Path Planning
  • 10. Imitation Learning
  • 11. Reinforcement Learning
  • 12. Experts

0. Review Papers

[Foundations and Trends in Robotics] 2020-Semantics for Robotic Mapping, Perception and Interaction: A Survey, [paper]

[AIRE] 2020-Vision-based Robotic Grasp Detection From Object Localization, Object Pose Estimation To Grasp Estimation: A Review, [paper]

[arXiv] 2020-Affordances in Robotic Tasks - A Survey, [paper]

[arXiv] 2019-A Review of Robot Learning for Manipulation- Challenges, Representations, and Algorithms, [paper]

[arXiv] 2018-The Limits and Potentials of Deep Learning for Robotics, [paper]

[MTI] 2018-Review of Deep Learning Methods in Robotic Grasp Detection, [paper]

[ToR] 2016-Data-Driven Grasp Synthesis - A Survey, [paper]

[RAS] 2012-An overview of 3D object grasp synthesis algorithms - A Survey, [paper]


1. Object Localization

1.1 Object Localization without Classification

1.1.1 2D-based Methods

a.Fitting 2D Shape Primitives

[BMVC] A buyer’s guide to conic fitting, [paper] [code]

[IJGIG] Algorithms for the reduction of the number of points required to represent a digitized line or its caricature, [paper] [code]

b. Saliency Detection

Survey papers:

[arXiv] 2020-RGB-D Salient Object Detection: A Survey, [paper] [project]

[arXiv] 2019-Salient object detection in the deep learning era: An in-depth survey, [paper]

[CVM] 2014-Salient object detection: A survey, [paper]

2020:

[ECCV] Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detection, [paper]

[ECCV] Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detection, [paper]

[ECCV] Cross-Modal Weighting Network for RGB-D Salient Object Detection, [paper]

[arXiv] Bilateral Attention Network for RGB-D Salient Object Detection, [paper]

[arXiv] Salient Object Detection Combining a Self-attention Module and a Feature Pyramid Network, [paper]

[arXiv] JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection, [paper]

[arXiv] UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoders, [paper]

[arXiv] Cross-layer Feature Pyramid Network for Salient Object Detection, [paper]

[arXiv] Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detection, [paper]

[arXiv] Weakly-Supervised Salient Object Detection via Scribble Annotations, [paper]

[arXiv] Highly Efficient Salient Object Detection with 100K Parameters, [paper]

[arXiv] Global Context-Aware Progressive Aggregation Network for Salient Object Detection, [paper]

[arXiv] Adaptive Graph Convolutional Network with Attention Graph Clustering for Co-saliency Detection, [paper]

2019:

[ICCV] Employing deep part-object relationships for salient object detection, [[paper](http://openaccess.

Issues· 3 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Python

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月17日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言