{"id":128952,"date":"2017-09-13T09:20:19","date_gmt":"2017-09-13T13:20:19","guid":{"rendered":"https:\/\/today.uconn.edu\/?p=128952"},"modified":"2017-09-13T16:25:36","modified_gmt":"2017-09-13T20:25:36","slug":"teaching-robots-think","status":"publish","type":"post","link":"https:\/\/today.uconn.edu\/2017\/09\/teaching-robots-think\/","title":{"rendered":"Teaching Robots to Think"},"content":{"rendered":"<p>In a research building in the heart of UConn\u2019s Storrs campus, assistant professor Ashwin Dani is teaching a life-size industrial robot how to think.<\/p>\n<p>Here, on a recent day inside the University\u2019s <a href=\"http:\/\/wp.rcl.engr.uconn.edu\/\">Robotics and Controls Lab<\/a>, Dani and a small team of graduate students are showing the humanoid bot <a href=\"https:\/\/www.youtube.com\/watch?v=CGCAGZwkk4Y\">how to assemble a simple desk drawer<\/a>.<\/p>\n<p>The &#8220;eyes&#8221; on the robot\u2019s face screen look on as two students build the wooden drawer, reaching for different tools on a tabletop as they work together to complete the task.<\/p>\n<p>The robot may not appear intently engaged. But it isn\u2019t missing a thing \u2013 or at least that\u2019s what the scientists hope. For inside the robot\u2019s circuitry, its processors are capturing and cataloging all of the humans\u2019 movements through an advanced camera lens and motion sensors embedded into his metallic frame.<\/p>\n<figure id=\"attachment_129324\" aria-describedby=\"caption-attachment-129324\" style=\"width: 640px\" class=\"wp-caption alignleft\"><a href=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a186.jpg\"><img decoding=\"async\" class=\"size-large wp-image-129324 img-responsive lazyload\" data-src=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a186-1024x683.jpg\" alt=\"Ashwin Dani, assistant professor of electrical and computer engineering, is developing algorithms and software for robotic manipulation, to improve robots' interaction with humans. (Sean Flynn\/UConn Photo)\" width=\"640\" height=\"427\" data-srcset=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a186-1024x683.jpg 1024w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a186-300x200.jpg 300w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a186-768x512.jpg 768w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a186-630x420.jpg 630w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a186-150x100.jpg 150w\" data-sizes=\"(max-width: 640px) 100vw, 640px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 640px; --smush-placeholder-aspect-ratio: 640\/427;\" \/><\/a><figcaption id=\"caption-attachment-129324\" class=\"wp-caption-text\">Ashwin Dani, assistant professor of electrical and computer engineering, is developing algorithms and software for robotic manipulation, to improve robots&#8217; interaction with humans. (Sean Flynn\/UConn Photo)<\/figcaption><\/figure>\n<p>Ultimately, the UConn scientists hope to develop software that will teach industrial robots how to use their sensory inputs to quickly \u201clearn\u201d the various steps for a manufacturing task \u2013 such as assembling a drawer or a circuit board \u2013\u00a0simply by watching their human counterparts do it first.<\/p>\n<p>\u201cWe\u2019re trying to move toward human intelligence,\u201d says Dani, the lab\u2019s director and a faculty member in the School of Engineering. \u201cWe\u2019re still far from what we want to achieve, but we\u2019re definitely making robots smarter.\u201d<\/p>\n<p>To further enhance robotic intelligence, the UConn team is also working on a series of complex algorithms that will serve as an artificial neural network for the machines, helping robots apply what they see and learn so they can one day assist humans at their jobs, such as assembling pieces of furniture or installing parts on a factory floor. If the process works as intended, these bots, in time, will know an assembly sequence so well, they will be able to anticipate their human partner\u2019s needs and pick up the right tools without being asked \u2013 even if the tools are not in the same location as they were when the robots were trained.<\/p>\n<p>This kind of futuristic human-robot interaction \u2013 called collaborative robotics \u2013 is transforming manufacturing. Industrial robots like the one in Dani\u2019s lab already exist. Although currently, engineers must write intricate computer code for all of the robot\u2019s individual movements or manually adjust the robot\u2019s limbs at each step in a process to program it to perform. Teaching industrial robots to learn manufacturing techniques simply by observing could reduce to minutes a process that currently can take engineers days.<\/p>\n<figure id=\"attachment_129325\" aria-describedby=\"caption-attachment-129325\" style=\"width: 550px\" class=\"wp-caption alignright\"><a href=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a183.jpg\"><img decoding=\"async\" class=\"wp-image-129325 img-responsive lazyload\" data-src=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a183-1024x683.jpg\" alt=\"From left back row, Ph.D. students Iman Salehi, Harish Ravichandar, Kyle Hunte, Gang Yao, and seated, Ashwin Dani, assistant professor of electrical and computer engineering. (Sean Flynn\/UConn Photo)\" width=\"550\" height=\"367\" data-srcset=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a183-1024x683.jpg 1024w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a183-300x200.jpg 300w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a183-768x512.jpg 768w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a183-630x420.jpg 630w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2017\/09\/robot170907a183-150x100.jpg 150w\" data-sizes=\"(max-width: 550px) 100vw, 550px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 550px; --smush-placeholder-aspect-ratio: 550\/367;\" \/><\/a><figcaption id=\"caption-attachment-129325\" class=\"wp-caption-text\">From left back row, Ph.D. students Iman Salehi, Harish Ravichandar, Kyle Hunte, Gang Yao, and seated, Ashwin Dani, assistant professor of electrical and computer engineering. (Sean Flynn\/UConn Photo)<\/figcaption><\/figure>\n<p>\u201cHere at UConn, we\u2019re developing algorithms that are designed to make robot programming easier and more adaptable,\u201d says Dani. \u201cWe are essentially building software that allows a robot to watch these different steps and, through the algorithms we\u2019ve developed, predict what will happen next. If the robot sees the first two or three steps, it can tell us what the next 10 steps are. At that point, it\u2019s basically thinking on its own.\u201d<\/p>\n<p>In recognition of this transformative research, UConn\u2019s Robotics and Controls Lab was recently chosen as one of 40 academic or academic-affiliated research labs supporting the U.S. government\u2019s newly created <a href=\"http:\/\/www.arminstitute.org\/\">Advanced Robotics for Manufacturing Institute or ARM<\/a>. One of the collaborative&#8217;s primary goals is to advance robotics and artificial intelligence to maintain American manufacturing competitiveness in the global economy.<\/p>\n<p>\u201cThere is a huge need for collaborative robotics in industry,\u201d says Dani. \u201cWith advances in artificial intelligence, lots of major companies like United Technologies, Boeing, BMW, and many small and mid-size manufacturers, are moving in this direction.\u201d<\/p>\n<p>The <a href=\"http:\/\/www.utrc.utc.com\/\">United Technologies Research Center<\/a>, <a href=\"http:\/\/utcaerospacesystems.com\/Pages\/Default.aspx\">UTC Aerospace Systems<\/a>, and <a href=\"http:\/\/www.abb.com\/cawp\/abbzh254\/28e44b375d070ae2c1256b5700521b84.aspxThe\">ABB US Corporate Research<\/a> \u2013 a leading international supplier of industrial robots and robot software \u2013 are also representing Connecticut as part of the new ARM Institute. The institute is led by American Robotics Inc., a nonprofit associated with Carnegie Mellon University.<\/p>\n<p>Connecticut\u2019s and UConn\u2019s contribution to the initiative will be targeted toward advancing robotics in the aerospace and shipbuilding industries, where intelligent, adaptable robots are more in demand because of the industries\u2019 specialized needs.<\/p>\n<p>Joining Dani on the ARM project are UConn Board of Trustees Distinguished Professor Krishna Pattipati, the University\u2019s UTC Professor in Systems Engineering and an expert in smart manufacturing; and assistant professor Liang Zhang, an expert in production systems engineering.<\/p>\n<p>&#8220;Robotics, with wide-ranging applications in manufacturing and defense, is a relatively new thrust area for the Department of Electrical and Computer Engineering,&#8221; says Rajeev Bansal, professor and head of UConn&#8217;s electrical and computer engineering department. &#8220;Interestingly, our first two faculty hires in the field received their doctorates in mechanical engineering, reflecting the interdisciplinary nature of robotics. With the establishment of the new national Advanced Robotics Manufacturing Institute, both UConn and the ECE department are poised to play a leadership role in this exciting field.&#8221;<\/p>\n<p>The aerospace, automotive, and electronics industries are expected to represent 75 percent of all robots used in the country by 2025. One of the goals of the ARM initiative is to increase small manufacturers&#8217; use of robots by 500 percent.<\/p>\n<p>Industrial robots have come a long way since they were first introduced, says <a href=\"http:\/\/wp.rcl.engr.uconn.edu\/people\/\">Dani<\/a>, who has worked with some of the country&#8217;s leading researchers in learning and adoptive control, and robotics at the University of Florida (<a href=\"http:\/\/ncr.mae.ufl.edu\/index.php?id=people\">Warren Dixon<\/a>) and the University of Illinois at Urbana-Champaign (<a href=\"http:\/\/www-cvr.ai.uiuc.edu\/~seth\/\">Seth Hutchinson<\/a> and <a href=\"https:\/\/aerospace.illinois.edu\/directory\/profile\/sjchung\">Soon-Jo Chung<\/a>). Many of the first factory robots were blind, rudimentary machines that were kept in cages and considered a potential danger to workers as their powerful hydraulic arms whipped back and forth on the assembly line.<\/p>\n<p>Today\u2019s advanced industrial robots are designed to be human-friendly. High-end cameras and elaborate motion sensors allow these robots to \u201csee\u201d and \u201csense\u201d movement in their environment. Some manufacturers, like Boeing and <a href=\"https:\/\/www.youtube.com\/watch?v=3qwlvc2kMDQ\">BMW<\/a>, already have robots and humans working side-by-side.<\/p>\n<p>Of course, one of the biggest concerns within collaborative robotics is safety.<\/p>\n<p>In response to those concerns, Dani\u2019s team is developing algorithms that will allow industrial robots to quickly process what they see and adjust their movements accordingly when unexpected obstacles \u2013\u00a0like a human hand \u2013\u00a0get in their way.<\/p>\n<p>\u201cTraditional robots were very heavy, moved very fast, and were very dangerous,\u201d says Dani. \u201cThey were made to do a very specific task, like pick up an object and move it from here to there. But with recent advances in artificial intelligence, machine learning, and improvements in cameras and sensors, working in close proximity with robots is becoming more and more possible.\u201d<\/p>\n<p>Dani acknowledges the obstacles in his field are formidable. Even with advanced optics, smart industrial robots need to be taught how to distinguish a metal rod from a flexible piece of wiring, and to understand the different physics inherent in each.<\/p>\n<p>Movements that humans take for granted are huge engineering challenges in Dani\u2019s lab. For instance: Inserting a metal rod into a pre-drilled hole is relatively easy. Knowing how to pick up a flexible cable and plug it into a receptacle is another challenge altogether. If the robot grabs the cable too far away from the plug, it will likely flex and bend. Even if the robot grabs the cable properly, it must not only bring the plug to the receptacle but also make sure the plug is oriented properly so it matches the receptacle precisely.<\/p>\n<p>\u201cPerception is always a challenging problem in robotics,\u201d says Dani. \u201cIn artificial intelligence, we are essentially teaching the robot to process the different physical phenomena it observes, make sense out of what it sees, and then make the appropriate response.\u201d<\/p>\n<p><em>Research in UConn\u2019s Robotics and Controls Lab is supported by funding from the U.S. Department of Defense and the UTC Institute of Advanced Systems Engineering. More detailed information about this research being conducted at UConn, including peer-reviewed article citations documenting the research, can be found <a href=\"http:\/\/wp.rcl.engr.uconn.edu\/publications\/\">here<\/a>. Dani and graduate student Harish Ravichandar also have two patents pending on aspects of this research: \u201cEarly Prediction of an Intention of a User\u2019s Actions,\u201d Serial #15\/659,827,\u00a0and\u00a0\u201cSkill Transfer From a Person to a Robot,\u201d Serial #15\/659,881.<\/em><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>UConn engineers are probing the frontier of artificial intelligence to advance manufacturing.<\/p>\n","protected":false},"author":12,"featured_media":129326,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_crdt_document":"","wds_primary_category":0,"wds_primary_series":0,"wds_primary_attribution":0,"footnotes":""},"categories":[1866,2459,2076,1862,1875,2225],"tags":[],"magazine-issues":[],"coauthors":[1928],"class_list":["post-128952","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-engr","category-graduate-students","category-research","category-busn","category-grad-school","category-uconn-storrs"],"pp_statuses_selecting_workflow":false,"pp_workflow_action":"current","pp_status_selection":"publish","acf":[],"publishpress_future_action":{"enabled":false,"date":"2026-05-31 03:54:04","action":"change-status","newStatus":"draft","terms":[],"taxonomy":"category","extraData":[]},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/128952","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/comments?post=128952"}],"version-history":[{"count":13,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/128952\/revisions"}],"predecessor-version":[{"id":129349,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/128952\/revisions\/129349"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/media\/129326"}],"wp:attachment":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/media?parent=128952"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/categories?post=128952"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/tags?post=128952"},{"taxonomy":"magazine-issue","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/magazine-issues?post=128952"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/coauthors?post=128952"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}