{"id":2832,"date":"2019-11-19T06:34:06","date_gmt":"2019-11-19T06:34:06","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2019\/11\/19\/gartner-and-forrester-begin-to-weigh-in-on-automated-machine-learning-aml\/"},"modified":"2019-11-19T06:34:06","modified_gmt":"2019-11-19T06:34:06","slug":"gartner-and-forrester-begin-to-weigh-in-on-automated-machine-learning-aml","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2019\/11\/19\/gartner-and-forrester-begin-to-weigh-in-on-automated-machine-learning-aml\/","title":{"rendered":"Gartner and Forrester Begin to Weigh in on Automated Machine Learning (AML)"},"content":{"rendered":"<p>Author: William Vorhies<\/p>\n<div>\n<p><strong><em>Summary:\u00a0<\/em><\/strong> <em>AML has been around since at least 2016 but only in the last year have Gartner and Forrester begun to offer their opinions.\u00a0 Here\u2019s where we stand.<\/em><\/p>\n<p>\u00a0<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/3719058268?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/3719058268?profile=RESIZE_710x\" width=\"350\" class=\"align-right\"><\/a>This has been a big year for AML (automated machine learning).\u00a0 A number of new players have emerged and pretty much everyone acknowledges that some level of automation is appropriate to enhance the productivity of your data science team.\u00a0 And no, data scientists shouldn\u2019t be alarmed by this trend.\u00a0 None of this approaches letting an untrained person push the button and have a useful model pop out.<\/p>\n<p>And yet something keeps bugging me.\u00a0 I\u2019ve been following this trend since its emergence in about 2016 and there\u2019s still no good single source to turn to for comprehensive reviews and comparisons.\u00a0 Another way of saying this is that if Forrester and Gartner haven\u2019t reviewed AML, does this really represent something to pay attention to.<\/p>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>The Forrester New Wave\u2122: Automation-Focused Machine Learning Solutions, Q2 2019<\/strong><\/span><\/p>\n<p>We were excited earlier in the year when <em><u><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/automated-machine-learning-aml-comes-of-age-almost\">Forrester published its first ever AML review<\/a><\/u><\/em>.\u00a0 They picked some winners and losers and gave some good guidance for comparison.<\/p>\n<p>\u00a0<a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/2976826450?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/2976826450?profile=RESIZE_710x\" width=\"500\" class=\"align-center\"><\/a><\/p>\n<p>While the analysis was certainly up to Forrester\u2019s high professional standards it was disturbing that there were many high ranked players I had never even heard of. \u00a0Turns out participants were not selected based on some broad industry survey but from among those Forrester thought were leaders and who had submitted an RFP-like response.\u00a0 Research was limited to a 1 \u00bd hr. interview \/ demo and calls to some of their installed customers.\u00a0 Inclusion criteria required the vendor to have at least five installed customers and have a full spectrum AML offering.\u00a0<\/p>\n<p>So the vendors who participated were to an extent self-selected and there\u2019s no indication of who might have applied and been rejected.\u00a0 I suspect there are a number of other competitors who could have passed these hurdles.<\/p>\n<p>Well, some information is better than none so long as readers see that the field of competitors reviewed is not altogether objective.<\/p>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>What about Gartner?<\/strong><\/span><\/p>\n<p>So I was excited to see a recent report from Gartner \u201c<em><u><a href=\"https:\/\/www.datarobot.com\/resource\/gartner-report-dsml\/\">How Augmented Machine Learning is Democratizing Data Science<\/a><\/u><\/em>\u201d hoping this might be the first in a much awaited review of AML competitors.\u00a0 Unfortunately it is not.<\/p>\n<p>The report covers the generalities of AML platforms that can be used by professionals, proceeding on by category until arriving at the most completely automated like DataRobot and H2O.ai.\u00a0<\/p>\n<p>Gartner also seems insistent on applying its own naming convention referring to the category as \u2018augmented\u2019 machine learning which really isn\u2019t going to help the reader gain clarity since \u2018automated machine learning\u2019 is already the much more common phrase.<\/p>\n<p>There are a couple of observations here worth pointing out.<\/p>\n<ul>\n<li>Gartner believes that fewer than 2% of models are currently being produced using AML (2019) but offers no data to support this.<\/li>\n<li>They project 40% by 2023 (four years) and that 50% of DS activities (a different measure) will be automated by 2025. Wish they would provide some support for these forecasts.<\/li>\n<\/ul>\n<p>Perhaps most interesting, and I wonder if this is an oversight in the report, is that their interpretation of AML includes the automation of deep learning models (ADL) for image and text.\u00a0 There are a handful of current AML competitors able to do this but it\u2019s unclear how much customers want this bulked up capability.\u00a0<\/p>\n<p>See our recent analysis of <em><u><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/it-s-official-our-dnn-models-are-now-commodity-software\">Booz Allen\u2019s Modzy<\/a><\/u><\/em> launch as perhaps a more efficient path to providing DNN models to those who need them.\u00a0 Let\u2019s be honest, probably 90% of the value being created by models comes from our well understood ML techniques and not the unusual problems that rely on text, voice, and image classification.<\/p>\n<p>\u00a0<\/p>\n<p><strong>Who Do Forrester and Gartner Think Should be Considered<\/strong><\/p>\n<p>Neither of these reports is based on a comprehensive market penetration survey but it\u2019s interesting to see the overlap.<\/p>\n<table width=\"410\">\n<tbody>\n<tr>\n<td width=\"336\">\n<p style=\"text-align: left;\"><strong>Forrester<\/strong><\/p>\n<\/td>\n<td width=\"336\" style=\"text-align: left;\">\n<p><strong>Gartner<\/strong><\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>DataRobot<\/p>\n<\/td>\n<td width=\"336\">\n<p>DataRobot<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>H2O.ai<\/p>\n<\/td>\n<td width=\"336\">\n<p>H2O.ai<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>Aible<\/p>\n<\/td>\n<td width=\"336\">\n<p>Aible<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>Big Squid<\/p>\n<\/td>\n<td width=\"336\">\n<p>Big Squid<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>\u00a0<\/p>\n<\/td>\n<td width=\"336\">\n<p>Tazi<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>Bell Integrator<\/p>\n<\/td>\n<td width=\"336\">\n<p>\u00a0<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>Squark<\/p>\n<\/td>\n<td width=\"336\">\n<p>\u00a0<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>DMway Analytics<\/p>\n<\/td>\n<td width=\"336\">\n<p>\u00a0<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>dotData<\/p>\n<\/td>\n<td width=\"336\">\n<p>\u00a0<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"336\">\n<p>EdgeVerve<\/p>\n<\/td>\n<td width=\"336\">\n<p>\u00a0<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>\u00a0<\/p>\n<p><span style=\"font-size: 12pt;\"><strong>Who Got Left Out<\/strong><\/span><\/p>\n<p>The reader needs to be aware that your choices are broader than these two reports.\u00a0 First, we\u2019re missing the cloud based AML offerings from the likes of Amazon, Microsoft, Google and others.\u00a0<\/p>\n<p>Second, there\u2019s a long list of stand-alones that might be added to this list.\u00a0 There\u2019s no way to know if they were invited and didn\u2019t make the cut, or simply missed the invite.\u00a0 Based on my reading over the last few years my guess is that there are at least 30 AML platforms in some early stage of release.<\/p>\n<p>This is not an endorsement, but I was surprised for example not to see some of the following included:<\/p>\n<ul>\n<li>Compellon<\/li>\n<li>PurePredictive<\/li>\n<li>x.ai<\/li>\n<li>Xpanse Analytics<\/li>\n<li>BigML<\/li>\n<\/ul>\n<p>Some even offer automated deep learning as part of their platform if you\u2019re ready to move in that direction.<\/p>\n<p>So these were not the comprehensive studies we\u2019ve been waiting for.\u00a0 But given the fact that, as Gartner puts it, 40% of our ML tasks will be automated over the next four years, we are all anticipating the full on AML studies from both these excellent sources.<\/p>\n<p>\u00a0<\/p>\n<p>\u00a0<\/p>\n<p><strong>Additional articles on Automated Machine Learning, Automated Deep Learning, and Other No-Code Solutions<\/strong><\/p>\n<p><em><u><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/complete-hands-off-automated-machine-learning\">Complete Hands-Off Automated Machine Learning<\/a><\/u> (October 2019)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/automated-machine-learning-for-professionals-updated\"><em><u>Automated Machine Learning for Professionals \u2013 Updated<\/u><\/em><\/a> <em>(August 2019)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/thinking-about-moving-up-to-automated-machine-learning-aml\"><em><u>Thinking about Moving Up to Automated Machine Learning (AML)<\/u><\/em><\/a> <em>(July 2019)<\/em><\/p>\n<p><em><u><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/automated-machine-learning-aml-comes-of-age-almost\">Automated Machine Learning (AML) Comes of Age \u2013 Almost<\/a><\/u> (July 2019)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/practicing-no-code-data-science\"><em><u>Practicing \u2018No Code\u2019 Data Science<\/u><\/em><\/a><em>\u00a0 (October 2018)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/what-s-new-in-data-prep\"><em><u>What\u2019s New in Data Prep<\/u><\/em><\/a><em><u>\u00a0<\/u> (September 2018)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/democratizing-deep-learning-the-stanford-dawn-project\"><em><u>Democratizing Deep Learning \u2013 The Stanford Dawn Project<\/u><\/em><\/a><em><u>\u00a0<\/u> (September 2018)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/transfer-learning-deep-learning-for-everyone\"><em><u>Transfer Learning \u2013Deep Learning for Everyone<\/u><\/em><\/a><em><u>\u00a0<\/u> (April 2018)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/automated-deep-learning-so-simple-anyone-can-do-it\"><em><u>Automated Deep Learning \u2013 So Simple Anyone Can Do It<\/u><\/em><\/a><em><u>\u00a0<\/u> (April 2018)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/next-generation-automated-machine-learning-aml\"><em><u>Next Generation Automated Machine Learning (AML)<\/u><\/em><\/a> <em>(April 2018)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/more-on-fully-automated-machine-learning\"><em>More on Fully Automated Machine Learning<\/em><\/a><em>\u00a0 (August 2017)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/automated-machine-learning-for-professionals\"><em>Automated Machine Learning for Professionals<\/em><\/a><em>\u00a0 (July 2017)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/data-scientists-automated-and-unemployed-by-2025-update\"><em>Data Scientists Automated and Unemployed by 2025 &#8211; Update!<\/em><\/a><em>\u00a0 (July 2017)<\/em><\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/data-scientists-automated-and-unemployed-by-2025\"><em><u>Data Scientists Automated and Unemployed by 2025!<\/u><\/em><\/a><em>\u00a0 (April 2016)<\/em><\/p>\n<p>\u00a0<\/p>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blog\/list?user=0h5qapp2gbuf8\"><em><u>Other articles by Bill Vorhies<\/u><\/em><\/a><\/p>\n<p>\u00a0<\/p>\n<p>About the author:\u00a0 Bill is Contributing Editor for Data Science Central.\u00a0 Bill is also President &#038; Chief Data Scientist at Data-Magnum and has practiced as a data scientist since 2001.\u00a0 His articles have been read more than 2 million times.<\/p>\n<p>He can be reached at:<\/p>\n<p><a href=\"mailto:Bill@DataScienceCentral.com\">Bill@DataScienceCentral.com<\/a> <span>or<\/span> <a href=\"mailto:Bill@Data-Magnum.com\">Bill@Data-Magnum.com<\/a><\/p>\n<p><span>\u00a0<\/span><\/p>\n<\/div>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/xn\/detail\/6448529:BlogPost:908995\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: William Vorhies Summary:\u00a0 AML has been around since at least 2016 but only in the last year have Gartner and Forrester begun to offer [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2019\/11\/19\/gartner-and-forrester-begin-to-weigh-in-on-automated-machine-learning-aml\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":457,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/2832"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=2832"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/2832\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/456"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=2832"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=2832"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=2832"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}