{"id":1286,"date":"2018-11-13T06:31:00","date_gmt":"2018-11-13T06:31:00","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2018\/11\/13\/a-wetware-approach-to-artificial-general-intelligence-agi\/"},"modified":"2018-11-13T06:31:00","modified_gmt":"2018-11-13T06:31:00","slug":"a-wetware-approach-to-artificial-general-intelligence-agi","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2018\/11\/13\/a-wetware-approach-to-artificial-general-intelligence-agi\/","title":{"rendered":"A Wetware Approach to Artificial General Intelligence (AGI)"},"content":{"rendered":"<p>Author: William Vorhies<\/p>\n<div>\n<p><strong><em>Summary:<\/em><\/strong> <em>\u00a0Researchers in Synthetic Neuro Biology are proposing to solve the AGI problem by building a brain in the laboratory.\u00a0 This is not science fiction.\u00a0 They are virtually at the door of this capability.\u00a0 Increasingly these researchers are presenting at major AGI conferences.\u00a0 Their argument is compelling.<\/em><\/p>\n<p>\u00a0<\/p>\n<p><a href=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2KjElTlrzqQjUj*YldMOjfafjqxJXPvFbOPfs*t-RVHZGm*t620u-av1Us1SKNa4slHMCodfl0cuUOeFAcfYOZH\/AGIxsmall.jpg\" target=\"_self\"><img decoding=\"async\" src=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2KjElTlrzqQjUj*YldMOjfafjqxJXPvFbOPfs*t-RVHZGm*t620u-av1Us1SKNa4slHMCodfl0cuUOeFAcfYOZH\/AGIxsmall.jpg?width=250\" width=\"250\" class=\"align-right\"><\/a>If you step outside of all the noise around AI and the hundreds or even thousands of startups trying to add AI to your car, house, city, toaster, or dog you can start trying to figure out where all this is going.<\/p>\n<p>Here\u2019s what I think we know:<\/p>\n<ol>\n<li>The narrow and pragmatic DNN approaches to speech, text, image, and video are getting better all the time. Transfer learning is making this a little easier.<\/li>\n<li>Reinforcement learning is coming along as are GANNs and those will certainly help. Commercialization is a few years away.<\/li>\n<li>The next generation of neuromorphic (spiking) chips are just entering commercial production (BrainChip, EtaCompute) and those will result in dramatic reductions in training datasets, training time, size, and energy consumption. In addition, we hope they can learn from one system and apply it to another.<\/li>\n<\/ol>\n<p>But what about <strong>artificial general intelligence (AGI)<\/strong> that we all believe will be the end state of these efforts?\u00a0 When will we get AGI that brings fully human capabilities, learns like a human, and can adapt knowledge like a human?<\/p>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>How Far Away is AGI?<\/strong><\/span><\/p>\n<p>When I looked into this two years ago the range of estimates was around 2025 to 2040.\u00a0<\/p>\n<p>With a few years more experience under our belt, here are the estimates given by 7 leading thinkers and investors in AI (including Ben Goertzel and Steve Jurvetson) at a 2017 conference on Machine Learning at the University of Toronto when asked \u2018How far away is AGI\u2019.\u00a0<\/p>\n<ul>\n<li>5 years to subhuman capability<\/li>\n<li>7 years<\/li>\n<li>13 years maybe (By 2025 we\u2019ll know if we can have it by 2030)<\/li>\n<li>23 years (2040)<\/li>\n<li>30 years (2047)<\/li>\n<li>30 years<\/li>\n<li>30 to 70 years<\/li>\n<\/ul>\n<p>There\u2019s significant disagreement but the median is 23 years (2040) with half the group thinking longer.\u00a0 Sounds like we\u2019re learning that this may be harder than we think.<\/p>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>What\u2019s the Most Likely Path to AGI?<\/strong><\/span><\/p>\n<p>Folks who think about this say that everything we\u2019ve got today in DNNs and reinforcement learning is by definition \u2018weak\u2019 AI.\u00a0 That is it mimics some elements of human cognition but doesn\u2019t achieve it in the same way humans do.<\/p>\n<p>This may or may not also be true of <a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/more-on-3rd-generation-spiking-neural-nets\"><em><u>next gen Spiking neural nets<\/u><\/em><\/a> that have adapted some new elements from neuroscience research.\u00a0 They look like they\u2019re a step in the right direction but we really don\u2019t know yet.<\/p>\n<p>There is general agreement that weak AI, while commercially valuable will never give us AGI.\u00a0 Only if we create broad and strong AI systems that mimic human reasoning can we ever achieve AGI.<\/p>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>Is this all on the Same Incremental Pathway?<\/strong><\/span><\/p>\n<p>So far there have been two primary schools of thought.\u00a0<\/p>\n<p>The <strong>Top Down<\/strong> school is an extension of our current incremental engineering approach.\u00a0 Basically it says that once the sum of all these engineering problems is resolved the resulting capabilities will in fact be AGI.\u00a0<\/p>\n<p>Those who disagree however say that truly human-like intelligence can never be the result of simply adding up a group of specific algorithms.\u00a0 Human intelligence could never be reduced to the sum of mathematical parts and neither can AGI.<\/p>\n<p>The <strong>Bottom Up<\/strong> school is the realm of researchers who propose to build a silicon analogue of the entire human brain.\u00a0 They propose to build an all-purpose generalized platform based on an exact simulation of human brain function.\u00a0 Once it\u2019s available it will immediately be able to do everything our current piecemeal approach has accomplished and much more.<\/p>\n<p>Personally, my bet is on the Bottom Up school though I think we are learning valuable hardware and software lessons along the way from our pragmatic DNN approach.<\/p>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>How About a Radical New Path<\/strong><\/span><\/p>\n<p>What I discovered in revisiting all this is that my own thinking has been too constrained.\u00a0 For example, in writing about 3<sup>rd<\/sup> gen spiking neural nets or the <a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/off-the-beaten-path-htm-based-strong-ai-beats-rnns-and-cnns-at-pr\"><em><u>neuromorphic modeling approach of Jeff Hawkins<\/u><\/em><\/a> at Numenta I assumed that hardware and software modeling of individual neurons interacting was the agreed approach.\u00a0<\/p>\n<p>Not only is this not true (I\u2019ll write more about this later), but our fundamental assumption about working in silicon is not the only approach being explored.<\/p>\n<p>Folks like neuroscientist George Church at Harvard are proposing that we simply build a brain in the biology lab and train it to do what we want it to.<\/p>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>Computational Synthetic Biology (CSB) \u2013 Wetware<\/strong><\/span><\/p>\n<p>Computational Synthetic Biology (aka synthetic neuro biology) is much further along than you think, and in terms of a 25 year forward timeline might just be the first horse to the finish line of AGI.<\/p>\n<p>As far back as 10 years ago, the field of Systems Biology sought to reduce molecular and atomic level cellular activities to \u2018bio-bricks\u2019 that could be strung together with different \u2018operators\u2019 to achieve an understanding of how these processes worked.\u00a0<\/p>\n<p>If Systems Biology is about understanding nature as it is, Computational Synthetic Biology takes the next step to understand nature as it could be.<\/p>\n<p style=\"text-align: center;\">Here\u2019s a graphic of the <a href=\"http:\/\/www.infobiotics.org\/infobiotics-workbench\/\"><em><u>Infobiotics Workbench<\/u><\/em><\/a> from 2010.\u00a0 Anyone familiar with predictive modeling will immediately recognize the similarities with a data analytics dashboard, including setting hyperparameters, loss functions, and comparing champion models.\u00a0<a href=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2JEnhcO5uVGnZYecWxBwLD*kxzI8LPFSRXfC72RKTCXrEBPMfI3PEpaibPaMP4VZy3dHwRI-8sJZQ2nWtSWHVks\/infobioticsworkbench.png\" target=\"_self\"><img decoding=\"async\" src=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2JEnhcO5uVGnZYecWxBwLD*kxzI8LPFSRXfC72RKTCXrEBPMfI3PEpaibPaMP4VZy3dHwRI-8sJZQ2nWtSWHVks\/infobioticsworkbench.png?width=500\" width=\"500\" class=\"align-center\"><\/a><span style=\"font-size: 8pt;\">Source: 2010 GECCO Conference Tutorial on Synthetic Biology\u00a0<\/span> <span style=\"font-size: 8pt;\">by Natalio Krasnogor, University of Nottingham.<\/span><\/p>\n<p>Fast forward to the 2018 O\u2019Reilly Artificial Intelligence Conference in New York where Harvard researcher George Church tells us just how much further we\u2019ve come.\u00a0 (<a href=\"https:\/\/www.safaribooksonline.com\/library\/view\/the-artificial-intelligence\/9781492025979\/video320244.html\"><em><u>See his original presentation here<\/u><\/em><\/a>. <em>Graphics that follow are from that presentation.<\/em>)<\/p>\n<p>Synthetic neuro biology (SNB) is already ahead of silicon simulations in both energy (much lower) and computational efficiency.\u00a0 Capabilities are increasing exponentially faster than Moore\u2019s Law, in some years by a factor of 10X.<\/p>\n<p>\u00a0<a href=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2LWGErmTcaukkEMBAnQuvQj5i*JkjCwm6ottkz8DxqL*YkFRXAoQQ6JY3*TaDXyvQykqkBlXpTayMg68Uf15EP4\/computingefficiency.png\" target=\"_self\"><img decoding=\"async\" src=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2LWGErmTcaukkEMBAnQuvQj5i*JkjCwm6ottkz8DxqL*YkFRXAoQQ6JY3*TaDXyvQykqkBlXpTayMg68Uf15EP4\/computingefficiency.png?width=400\" width=\"400\" class=\"align-center\"><\/a><\/p>\n<p>In the upper right, SNB is already operating close to the biological limit of compute efficiency.\u00a0 Church says silicon could catch up in 3 decades at the current growth rate, except that silicon is already plateauing.<\/p>\n<p>Church says \u201cWe are well on our way to reproducing every kind of structure in the brain\u201d.<\/p>\n<p>In the lab, he can already create all types of neurons to order including being able to build significant human cerebral cortex structures complete with supporting vasculature.\u00a0 This includes myelin wrapping of the axons so that signals can be sent over long distances at high speeds allowing action potentials to jump from node to node without signal dissipation.<\/p>\n<p>In short, the position of SNB researchers is it\u2019s easier to copy an unknown (brain function, human cognition, AGI) in a made-to-order biological brain than it is to translate that simulation into silicon.\u00a0 In the silicon simulation you\u2019ll never really know if it\u2019s actually right.<\/p>\n<p>To add one more level to these futuristic projections, what is the possibility that we can modify or augment our current physiology to create super intelligence?\u00a0 The field of biological augmentation is already well underway principally in the field of curing disease.\u00a0 Why not extend it?<\/p>\n<p>For example, the average human brain weighs 1.3 kg and consumes 20W of power (compared to the 85,000W required by Watson to win Jeopardy).\u00a0 What if we could enlarge it to 25kg, about 3X the size of a whale\u2019s brain, but still within the physical limit of what our skeletons could support?\u00a0 It seems the only penalty would be to have to provide about 100W of power, equivalent to eating about 8,000 calories per day.\u00a0 Donuts \u2013 yumm.\u00a0<a href=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2KDsYfCHLq1ehFJnznaindQ7s0NGfSEJagD-RDFwzIwNzKXAm6ID89iCU78og0zf9Afy0vnTIw4UIyDTfUDBl9o\/bigbrain.png\" target=\"_self\"><img decoding=\"async\" src=\"http:\/\/api.ning.com\/files\/pWFsdFRaG2KDsYfCHLq1ehFJnznaindQ7s0NGfSEJagD-RDFwzIwNzKXAm6ID89iCU78og0zf9Afy0vnTIw4UIyDTfUDBl9o\/bigbrain.png?width=400\" width=\"400\" class=\"align-center\"><\/a><\/p>\n<p><span style=\"font-size: 12pt;\"><strong>Could Silicon Based AGI Ever Be Completely Human-Like?<\/strong><\/span><\/p>\n<p>While silicon AGI modelers still struggle to understand brain function sufficiently to build their simulations there are legitimate questions about whether their best result will ever be enough.\u00a0 Will they ever have the capabilities that make us philosophically human?\u00a0 Our science fiction robots have some or all of these qualities:<\/p>\n<p><strong>Consciousness:<\/strong>\u00a0 To have subjective experience and thought.<\/p>\n<p><strong>Self-awareness:<\/strong>\u00a0 To be aware of oneself as a separate individual, especially to be aware of one\u2019s own thoughts and uniqueness.<\/p>\n<p><strong>Sentience:<\/strong>\u00a0 The ability to feel perceptions or emotions subjectively.<\/p>\n<p><strong>Sapience:<\/strong> The capacity for wisdom.<\/p>\n<p>If we construct an intelligent \u2018brain\u2019 in the lab from the same human biological components \u2013 is it still just a simulation?\u00a0 Will it be a \u2018mind\u2019?<\/p>\n<p>So far computational synthetic biological research remains in the lab or where it has matured, is being applied to cure disease.\u00a0 But increasingly researchers like George Church are presenting at major AGI conferences.\u00a0 They are already able to skip the entire step of creating a silicon analog of the brain where most silicon AGI researchers are currently stuck.\u00a0 If there\u2019s a 15 or 25 year runway to develop AGI, I wouldn\u2019t bet against this wetware approach.<\/p>\n<p>\u00a0<\/p>\n<p>\u00a0<\/p>\n<p><strong>Other articles on AGI:<\/strong><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/in-search-of-artificial-general-intelligence-agi\"><em><u>In Search of Artificial General Intelligence (AGI)<\/u><\/em><\/a> <em><u>(2017)<\/u><\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/artificial-general-intelligence-the-holy-grail-of-ai\"><em><u>Artificial General Intelligence \u2013 The Holy Grail of AI<\/u><\/em><\/a> <em><u>(2016)<\/u><\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blog\/list?user=0h5qapp2gbuf8\"><em><u>Other articles by Bill Vorhies.<\/u><\/em><\/a><\/p>\n<p>\u00a0<\/p>\n<p>About the author:\u00a0 Bill Vorhies is Editorial Director for Data Science Central and has practiced as a data scientist since 2001.\u00a0 He can be reached at:<\/p>\n<p><a href=\"mailto:Bill@DataScienceCentral.com\">Bill@DataScienceCentral.com<\/a><\/p>\n<\/div>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/xn\/detail\/6448529:BlogPost:723530\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: William Vorhies Summary: \u00a0Researchers in Synthetic Neuro Biology are proposing to solve the AGI problem by building a brain in the laboratory.\u00a0 This is [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2018\/11\/13\/a-wetware-approach-to-artificial-general-intelligence-agi\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":470,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/1286"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=1286"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/1286\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/466"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=1286"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=1286"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=1286"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}