{"id":509,"date":"2017-10-17T19:49:33","date_gmt":"2017-10-17T19:49:33","guid":{"rendered":"http:\/\/pybullet.org\/wordpress\/?p=509"},"modified":"2019-03-30T19:51:49","modified_gmt":"2019-03-30T19:51:49","slug":"multi-task-domain-adaptation-for-deep-learning-of-instance-grasping-from-simulation","status":"publish","type":"post","link":"https:\/\/pybullet.org\/wordpress\/index.php\/2017\/10\/17\/multi-task-domain-adaptation-for-deep-learning-of-instance-grasping-from-simulation\/","title":{"rendered":"Multi-Task Domain Adaptation for Deep Learning of Instance Grasping from Simulation"},"content":{"rendered":"<p>A new paper from Google Brain and X using PyBullet:<br \/>\nearning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by utilizing simulated robot experiments. Our neural network takes monocular RGB images and the instance segmentation mask of a specified target object as inputs, and predicts the probability of successfully grasping the specified object for each candidate motor command. The proposed transfer learning framework trains a model for instance grasping in simulation and uses a domain-adversarial loss to transfer the trained model to real robots using indiscriminate grasping data, which is available both in simulation and the real world. We evaluate our model in real-world robot experiments, comparing it with alternative model architectures as well as an indiscriminate grasping baseline.<\/p>\n<p>See also <a href=\"https:\/\/sites.google.com\/corp\/view\/multi-task-domain-adaptation\">https:\/\/sites.google.com\/corp\/view\/multi-task-domain-adaptation<\/a> and<br \/>\n<a href=\"https:\/\/arxiv.org\/abs\/1710.06422\">https:\/\/arxiv.org\/abs\/1710.06422<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A new paper from Google Brain and X using PyBullet: earning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by utilizing simulated robot experiments. Our neural network takes monocular RGB images &hellip; <a href=\"https:\/\/pybullet.org\/wordpress\/index.php\/2017\/10\/17\/multi-task-domain-adaptation-for-deep-learning-of-instance-grasping-from-simulation\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Multi-Task Domain Adaptation for Deep Learning of Instance Grasping from Simulation<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_links_to":"","_links_to_target":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/509"}],"collection":[{"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/comments?post=509"}],"version-history":[{"count":2,"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/509\/revisions"}],"predecessor-version":[{"id":511,"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/509\/revisions\/511"}],"wp:attachment":[{"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/media?parent=509"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/categories?post=509"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pybullet.org\/wordpress\/index.php\/wp-json\/wp\/v2\/tags?post=509"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}