{"id":1874,"date":"2019-03-15T16:05:01","date_gmt":"2019-03-15T16:05:01","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2019\/03\/15\/exercises-in-amazement-discovering-deep-learning\/"},"modified":"2019-03-15T16:05:01","modified_gmt":"2019-03-15T16:05:01","slug":"exercises-in-amazement-discovering-deep-learning","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2019\/03\/15\/exercises-in-amazement-discovering-deep-learning\/","title":{"rendered":"Exercises in amazement: Discovering deep learning"},"content":{"rendered":"<p>Author: Department of Electrical Engineering and Computer Science<\/p>\n<div>\n<p>It was standing-room only in the Stata Center\u2019s Kirsch Auditorium when some 300 attendees showed up for opening lectures for MIT\u2019s intensive, student-designed course 6.S191 (<a href=\"http:\/\/introtodeeplearning.com\/\">Introduction to Deep Learning<\/a>).<\/p>\n<p>Nathan Rebello, a first-year graduate student in chemical engineering, was among those who were excited about the class, coordinated by Alexander Amini \u201917 and Ava Soleimany \u201916 during MIT\u2019s Independent Activities Period (IAP) in January.<\/p>\n<p>\u201cI hope to go into either industry or academia and to apply deep learning techniques for the design of new materials,\u201d Rebello says. He signed up for 6.S191 to learn more about deep learning with the intention of applying it to the design of bio-inspired polymeric materials, adding: \u201cI also wanted to network with students and faculty to explore their ways of thinking on this topic.\u201d<\/p>\n<p>There were plenty of people available for networking. \u201cWe want the class to be open and accessible to the broader community,\u201d says Soleimany, a MIT and Harvard University graduate student, who, with Amini, also served as an instructor for the course. \u201cWe welcome people from outside MIT. There were many students from surrounding universities in Boston and even specialized physicians from Mass General Hospital. We had people fly in from California and from outside the country, from Turkey and China, to attend the lectures.\u201d<\/p>\n<p>The for-credit course has been offered for the past three years. A subset of artificial intelligence (AI), deep learning focuses on building predictive models automatically from big data. Each class consisted of technical lectures followed by software labs where students could immediately apply what they had learned. Technical lectures spanned state-of-the-art techniques in deep learning, and included lectures on computer vision, reinforcement learning, and natural language processing given by Amini and Soleimany, as well as guest lectures by leading AI researchers from Google, IBM, and Nvidia.<\/p>\n<p>\u201cThis year, we remade the software labs totally from scratch and collaborated very closely with the Google Brain team to reflect the newest version of the framework TensorFlow, the language which we were using for the labs,\u201d says Amini, a PhD student in MIT\u2019s Computer Science and Artificial Intelligence Laboratory. \u201cTensorFlow is the most popular machine learning and deep learning framework out there.\u201d<\/p>\n<p>One specific lab featured <a href=\"https:\/\/www.csail.mit.edu\/news\/ai-de-biases-algorithms\">research<\/a> that Amini and Soleimany recently published in the Association for the Advancement of Artificial Intelligence\/Association for Computing Machinery Conference on Artificial Intelligence, Ethics, and Society. \u201cThe focus is on building facial detection systems and using deep learning to make them unbiased with respect to things like gender and race,\u201d Soleimany says. \u201cThis is a really exciting piece of work, but it\u2019s also really pragmatic work, because there\u2019s been a lot of news recently on AI being biased towards certain underrepresented minorities. To have students not only understand why that bias might arise, but also try to use deep learning to actually remove some of that bias was really cool. It\u2019s cutting-edge work.\u201d<\/p>\n<p>For final projects, 6.S191 students could either write a brief review of a new deep learning paper or present a three-minute oral proposal for a deep learning application, to be judged by industry representatives.<\/p>\n<p>This year, some 20 groups comprising two to four people completed projects, competing for high-end graphics processing units (GPUs) provided by Nvidia, each worth more than $1,000, and AI home assistants provided by Google.<\/p>\n<p>One winning team proposed using deep learning to detect deformation in 2-D materials on a micro scale or even smaller. A second group proposed using it to design new catalysts for chemistry applications. The final group proposed using deep learning to analyze the X-rays of scoliosis patients.<\/p>\n<p>\u201cWe thought that these three projects stood out in terms of their immediate applications and that these teams would take the GPUs and really put them to use,\u201d Soleimany says.<\/p>\n<p>Rebello, who had a basic knowledge of neural nets and TensorFlow before he enrolled in the course, was on the team that presented \u201cAdvanced Scoliosis Detection with Deep Neural Nets.\u201d<\/p>\n<p>\u201cEven though my teammates and I were from different disciplines, we pooled our knowledge and interests to propose the award-winning idea of a merger of convolutional neural networks with scoliosis detection, potentially enabling doctors to detect subtle abnormal features from X-rays in the early stages of scoliosis and classify the severity of the condition over time,\u201d Rebello says.<\/p>\n<p>\u201cThe project was a fun way to think outside of the box,\u201d says another member of the winning team, Eric A. Magliarditi, a graduate student in aeronautics and astronautics. The third team member, Sandra Liu, who is studying for a master&#8217;s degree in mechanical engineering, said she had little knowledge of deep learning before the class but was eager to learn about its applications to soft robotics, her academic interest. \u201cThe highlights of the course were the labs,\u201d she says. \u201cIn one, we got to complete the code for a neural net that could generate Irish folk songs. It was fun to be able to do \u2018hands-on\u2019 projects and also to learn more about real-life applications of deep learning.\u201d<\/p>\n<p>Magliarditi had a real-life interest in the topic the trio explored. \u201cI had advanced scoliosis \u2014 I had surgery to fix it in 2014 \u2014 so this topic was extremely relevant and interesting to me,\u201d he says. \u201cI am not entirely sure if our idea could work, but it is something I want to investigate further because it has some interesting consequences if it were to work.\u201d<\/p>\n<p>Not every idea presented was so practical. \u201cOne project was an AI personal assistant,\u201d says Amini. \u201cAnd though it may be far-fetched, a full-fledged AI assistant, essentially a micro-drone the size of an insect that would fly around the house and keep track of your personal belongings, would be pretty amazing.\u201d<\/p>\n<p>Amini and Soleimany plan to teach the deep learning course again during IAP 2020. In the meantime, the lectures from the 2019 class can be found <a href=\"http:\/\/introtodeeplearning.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">on the course website<\/a>.<\/p>\n<h3><\/h3>\n<\/div>\n<p><a href=\"http:\/\/news.mit.edu\/2019\/discovering-deep-learning-mit-iap-course-0315\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: Department of Electrical Engineering and Computer Science It was standing-room only in the Stata Center\u2019s Kirsch Auditorium when some 300 attendees showed up for [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2019\/03\/15\/exercises-in-amazement-discovering-deep-learning\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":474,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[24],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/1874"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=1874"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/1874\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/459"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=1874"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=1874"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=1874"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}