{"id":3904,"date":"2020-09-25T06:33:49","date_gmt":"2020-09-25T06:33:49","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2020\/09\/25\/gpt3-and-agi-beyond-the-dichotomy-part-one\/"},"modified":"2020-09-25T06:33:49","modified_gmt":"2020-09-25T06:33:49","slug":"gpt3-and-agi-beyond-the-dichotomy-part-one","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2020\/09\/25\/gpt3-and-agi-beyond-the-dichotomy-part-one\/","title":{"rendered":"GPT3 and AGI: Beyond the dichotomy &#8211; part one"},"content":{"rendered":"<p>Author: ajit jaokar<\/p>\n<div>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/7966756488?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/7966756488?profile=RESIZE_710x\" class=\"align-full\"><\/a><\/p>\n<p><span style=\"font-size: 14pt;\"><strong>Background<\/strong><\/span><\/p>\n<\/p>\n<p>Earlier this week, I spoke at an interesting online event organized by Khaleej times in the UAE (UAE&rsquo;s longest running daily English newspaper).<\/p>\n<p>This two-part blog is based on the talk. I addressed a hard topic &ndash; and one which I hope sparks some discussion.<\/p>\n<p>To summarize my talk:<\/p>\n<ul>\n<li>The discussion of whether GPT3 is AGI or not is dominated by either hype or dichotomy.<\/li>\n<li>We need to think past both these polarizing mindsets because hype misleads discussion and dichotomy stifles discussion.<\/li>\n<li>If we do so, then what are the implications for AGI?<\/li>\n<\/ul>\n<p>In part one &ndash; I lay the background of the discussion in more detail.<\/p>\n<p><span style=\"font-size: 14pt;\"><strong>Some terminology:<\/strong><\/span><\/p>\n<p><u>Narrow AI<\/u> &#8211; systems that can only perform one specific task.<\/p>\n<p><u>Strong AI<\/u> &ndash; AGI (Artificial General Intelligence). &#8211; which could perform any task as well as a human being, is a much harder problem because AGI needs to understand the context.<\/p>\n<p><u>GPT-3<\/u> &#8211; Created by OpenAI with a large investment from Microsoft, GPT stands for Generative Pretrained Transformer. GPT-3 is displaying some amazing results. Some call it more like AGI.<\/p>\n<p>PS &ndash; I had to refer to a few papers and links which are all mentioned in the text or at the end of part two.<\/p>\n<p><strong>&nbsp;<\/strong><\/p>\n<p><span style=\"font-size: 14pt;\"><strong>AGI ..<\/strong><\/span><\/p>\n<p>Outside of research circles (and scaremongering media!) &ndash; AGI is not on most people&rsquo;s radar. AGI would not have been a topic of recent discussions had it not been for GPT3.<\/p>\n<p>So, there are two initial questions to consider:<\/p>\n<ul>\n<li>Can we build AGI using current tools, OR do we need to make new fundamental discoveries about how the mind\/consciousness works?<\/li>\n<li>What is intelligence and do we need different metrics to evaluate new forms of intelligence?<\/li>\n<\/ul>\n<p>Consider the first question:<\/p>\n<p>Can we build AGI using current tools, OR do we need to make new fundamental discoveries about the mind\/consciousness works?<\/p>\n<p>Ray Kuzweil said in his book <span><a href=\"https:\/\/en.wikipedia.org\/wiki\/How_to_Create_a_Mind\">How to create a mind<\/a><\/span><\/p>\n<p><em>&ldquo;there is no fundamental difference between humans and machines, and that humans are machines whose &#8220;intelligence&#8221; emerges from the interplay of the many unintelligent but semi-autonomous agents that comprise the brain.&rdquo;<\/em><\/p>\n<p>Aka if we define &lsquo;intelligence&rsquo; as emerging from the interaction of many simple, semi-autonomous entities &ndash; then there is no difference between human intelligence and intelligence from artificial neurons.&nbsp;<\/p>\n<p>The alternate view is: we are missing key components to create artificial minds and we (as human beings) need to add these elements. In doing so, we create intelligence (conveniently in our own image)<\/p>\n<p>What are we missing in the second view?<\/p>\n<p>Intelligence could be:<\/p>\n<ul>\n<li>multi-model<\/li>\n<li>incremental<\/li>\n<li>physical<\/li>\n<li>exploratory<\/li>\n<li>social<\/li>\n<li>use language<\/li>\n<\/ul>\n<p>(source Prof Jitendra Malik)<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>So, coming back to the first view i.e. simple interactions lead to intelligence without humans imposing any criteria on it .. then that means its simply a matter of throwing more data and computing power at the problem.<\/p>\n<p>A recent essay also refers to this idea &#8211; &ldquo;<span><a href=\"http:\/\/www.incompleteideas.net\/IncIdeas\/BitterLesson.html\">The Bitter Lesson<\/a><\/span>&rdquo;<\/p>\n<p><em>when researchers have tried to create AI programs based on human knowledge and specific rules, they&rsquo;ve generally been beaten by rivals that simply leveraged more data and computation. It&rsquo;s a bitter lesson because it shows that trying to pass on our precious human ingenuity doesn&rsquo;t work half so well as simply letting computers compute.<\/em><\/p>\n<p>The ever insightful Geoffrey Hinton tweeted cheekily: &ldquo;Extrapolating the spectacular performance of GPT3 into the future suggests that the answer to life, the universe and everything is just 4.398 trillion parameters.&rdquo;<\/p>\n<p>All this points to AGI potentially arising organically<\/p>\n<p>In the next section, we explore these ideas further<\/p>\n<p>&nbsp;<\/p>\n<p><span>&nbsp;&nbsp;<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>image source: <a href=\"https:\/\/www.youtube.com\/watch?v=ocALxrFa8w8\" target=\"_blank\" rel=\"noopener noreferrer\">Learn English Words: DICHOTOMY<\/a><\/p>\n<\/p>\n<p>&nbsp;<\/p>\n<\/div>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/xn\/detail\/6448529:BlogPost:981489\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: ajit jaokar Background Earlier this week, I spoke at an interesting online event organized by Khaleej times in the UAE (UAE&rsquo;s longest running daily [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2020\/09\/25\/gpt3-and-agi-beyond-the-dichotomy-part-one\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":461,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/3904"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=3904"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/3904\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/469"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=3904"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=3904"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=3904"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}