Learning to grasp using visual information

A scheme for learning to grasp objects using visual information is presented. The learning problem is divided into two separate subproblems: choosing grasping points and predicting the quality of a given grasp. For each grasp we store location parameters that code the locations of the grasping points, quality parameters that are relevant features for the assessment of grasp quality, and the associated grade. The location parameters, using a special coding which is not object specific, are used to locate grasping points on new target objects. A function from the quality parameters to the grade is learned from examples. Grasp quality for novel situations can be generalized and estimated using the learned function. An experimental setup using an AdeptOne manipulator was developed to test this scheme. The system had demonstrated an ability to grasp a relatively wide variety of objects, and its performance had significantly improved with practice following a small number of trials. The knowledge learned for a set of objects was successfully generalized to new objects.