{"id":5162,"date":"2021-10-31T06:33:46","date_gmt":"2021-10-31T06:33:46","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2021\/10\/31\/making-informed-decisions-in-imperfect-situations\/"},"modified":"2021-10-31T06:33:46","modified_gmt":"2021-10-31T06:33:46","slug":"making-informed-decisions-in-imperfect-situations","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2021\/10\/31\/making-informed-decisions-in-imperfect-situations\/","title":{"rendered":"Making Informed Decisions in Imperfect Situations"},"content":{"rendered":"<p>Author: Bill Schmarzo<\/p>\n<div>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9752424296?profile=original\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9752424296?profile=RESIZE_710x\" width=\"720\" class=\"align-full\"><\/a><\/p>\n<p>We live in a world where everyone needs to learn how to make informed decisions with incomplete and sometimes conflicting data. And that\u2019s a big challenge because humans are inherently bad at making decisions.\u00a0 And if you want proof, just visit Las Vegas.\u00a0 Yes, Las Vegas has figured out how to monetize our <strong>stupid human decision-making<\/strong> (SHDM) flaws (Figure 1).\u00a0<img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750915092?profile=RESIZE_710x\" class=\"align-full\"><\/p>\n<p><strong>Figure<\/strong> <strong>1<\/strong><strong>:<\/strong> <a href=\"https:\/\/dilbert.com\/strip\/2021-10-24\"><strong>Data-driven by Dilbert (Scott Adams)<\/strong><\/a><\/p>\n<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750915283?profile=original\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750915283?profile=RESIZE_710x\" class=\"align-full\"><\/a><\/p>\n<p><strong>Figure<\/strong> <strong>2<\/strong><strong>:<\/strong> <a href=\"https:\/\/www.linkedin.com\/feed\/update\/urn:li:ugcPost:6738207620345294848?updateEntityUrn=urn%3Ali%3Afs_feedUpdate%3A%28*%2Curn%3Ali%3AugcPost%3A6738207620345294848%29\"><strong>Human Decision-making Flaws<\/strong><\/a><\/p>\n<p>Unfortunately, every day we are asked to make important, sometimes life-or-death decisions with imperfect and\/or conflicting data.\u00a0 There is a whole class of decisions, <strong>preventive decisions,<\/strong> which are proactive actions taken to minimize the probability of serious injury or death.\u00a0 Examples of preventive decisions include:<\/p>\n<ul>\n<li>Wearing a seat belt<\/li>\n<li>Wearing a motorcycle or bicycle helmet<\/li>\n<li>Wearing eye, face, and head protection<\/li>\n<li>Wearing hearing protection<\/li>\n<li>Wearing gloves<\/li>\n<li>Not smoking<\/li>\n<li>Not drinking and operating machinery<\/li>\n<li>Safety lock for guns<\/li>\n<li>Wearing safety coats and aprons<\/li>\n<li>And, of course, getting vaccinated.<\/li>\n<\/ul>\n<p>Preventive decisions can be particularly tricky, especially in highly emotional (politicalized) situations where the costs associated with being wrong are distorted.\u00a0 We are seeing this situation play out in the real world with the COVID vaccination resistance (Figure 3).<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750915292?profile=original\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750915292?profile=RESIZE_710x\" class=\"align-full\"><\/a><\/p>\n<p><strong>Figure<\/strong> <strong>3<\/strong><strong>: COVID-19 Decision-making Extremes<\/strong><\/p>\n<p>\u201c<em>Nobody\u2019s right if everybody\u2019s wrong<\/em>\u201d \u2013 \u201c<a href=\"https:\/\/www.youtube.com\/watch?v=gp5JCrSXkJY\">For What It&#8217;s Worth<\/a>\u201d by Buffalo Springfield<\/p>\n<p>For my class at Menlo College, I am creating an exercise where the students will explore how to make informed decisions in situations of imperfect or even conflicting data (using the decision about wearing seatbelts).\u00a0 The exercise starts by reviewing a process for making informed decisions in imperfect situations.\u00a0 I call this \u201cDecision Literacy.\u201d<\/p>\n<h1><strong>Decision Literacy<\/strong><\/h1>\n<p>Whether we are overtly aware of it or not, everyone creates a \u201cmodel\u201d to guide their decision and gathers data as appropriate for the scale or importance of that decision.<\/p>\n<ul>\n<li>Some models can be quite extensive in gathering a broad range of data in making the decision, such as buying a house, buying a car, or deciding where to go on vacation.<\/li>\n<li>Other models are just straight-forward \u201crules of thumbs\u201d or heuristics such as changing the oil in your car every 3,000 miles, seeing a dentist every 6 months, or changing your underwear at least once a week.<\/li>\n<li>And, unfortunately, some decisions are based upon the loudest, most repetitive voice in the room. To quote Nazi Propaganda Minister Joseph Goebbels \u201cIf you tell a lie big enough and keep repeating it, people will eventually come to believe it.\u201d\u00a0 Sad, but true.<\/li>\n<\/ul>\n<h1><strong>Framing the Decision to be Made<\/strong><\/h1>\n<p>To aid in making informed decisions in imperfect situations of incomplete, conflicting, and\/or distorted data, we can embrace the Decision-making Framework of Figure 4.<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750915872?profile=original\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750915872?profile=RESIZE_710x\" class=\"align-full\"><\/a><\/p>\n<p><strong>Figure<\/strong> <strong>4<\/strong><strong>: Informed Decision-making Framework<\/strong><\/p>\n<p>Some steps in the Informed Decision-making Framework:<\/p>\n<ul>\n<li>\n<strong>Identify &amp; Triage Decision to Be Made.<\/strong> The starting point for decision making process is to create a <strong>hypothesis<a href=\"http:\/\/feeds.feedburner.com\/FeaturedBlogPosts-DataScienceCentral#_ftn1\" name=\"_ftnref1\"><span>[1]<\/span><\/a><\/strong> around which we are seeking to make a decision. Clearly state Decision Hypothesis that you wish to assessment, and KPIs against which Decision progress and success will be measured<\/li>\n<li>\n<strong>Create MECE Decision Matrix.<\/strong> Construct the mutually exclusive and collectively exhaustive (MECE) Decision Matrix that maps actions to potential outcomes.<\/li>\n<li>\n<strong>Research and Gather Data and Statistics.<\/strong> This step is tricky in that the sources and credibility of the data and statistics must be <strong>objectively<\/strong>\u00a0 Research and gather data and statistics for each cell of the MECE Decision Matrix with an assessment of the data reliability.<\/li>\n<li>\n<strong>Create Cost-Benefit Assessment.<\/strong> This is where a significant amount of time should be spent, especially if the decision has high consequence. Identify the direct and indirect costs and benefits of each cell of the MECE Decision Matrix.<\/li>\n<li>\n<strong>Explore Worst Case Scenarios.<\/strong> This step doesn\u2019t get nearly enough attention in the decision-making-process.\u00a0 Identify ramifications and costs of decision model being wrong; that is, what are the costs associated with making a wrong decision (sickness, death, embarrassment, a better world).<\/li>\n<li>\n<strong>Create Clear Presentation<\/strong>. Build analytic visuals and graphics that present the assessment in a format that enables the decision maker to make an informed decision.<\/li>\n<\/ul>\n<h1><strong>The Importance of Properly Framing the Decision to be Made<\/strong><\/h1>\n<p>How one frames the decision becomes important in the data gathering part of making an informed decision.\u00a0 Are you trying to gather data to determine the right decisions or are you gathering data to support the decision that you have already made?\u00a0<\/p>\n<ul>\n<li>Many folks succumb to <strong>confirmation bias<\/strong> \u2013 the tendency to interpret new evidence as confirmation of one&#8217;s existing beliefs or theories \u2013 and only seek data that supports the decision that they have already made.<\/li>\n<li>Finally, careful consideration must be given in presenting the resulting analytics in an unbiased way that helps us to make that informed decision.<\/li>\n<\/ul>\n<p>To reiterate this critical point in trying to make informed decisions:<\/p>\n<p><em>A true data scientist frames the hypothesis so that we can learn what decision is best versus framing the hypothesis to support the decision that we have already made.\u00a0<\/em><\/p>\n<p>There is a big difference!<\/p>\n<h1><strong>Befriending the Decision Matrix<\/strong><\/h1>\n<p>To evaluate our decision options (to wear or not wear a seatbelt, to get or not get vaccinated) requires the following steps:<\/p>\n<ol>\n<li>Identifying the different <strong>action-outcomes combinations<\/strong>\n<\/li>\n<li>Brainstorming, identifying, and validating the associated benefits and costs of making a decision for each action-outcomes combination<\/li>\n<li>Gather relevant data (even though the data may be incomplete) carefully considering the reliability, trust, and transparency of the data source<\/li>\n<li>Analyze, assemble, and present the data in a manner that enables making an informed decision considering the multiple action-outcome combinations<\/li>\n<\/ol>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750916897?profile=original\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750916897?profile=RESIZE_710x\" class=\"align-full\"><\/a><\/p>\n<p>The <strong>Decision Matrix<\/strong> can guide us in the data gathering and analysis process (Figure 5).<\/p>\n<p><strong>Figure<\/strong> <strong>5<\/strong><strong>: Decision Matrix<\/strong><\/p>\n<p>Objectivity is everything.\u00a0 If you come into this process with your mind already made up, then you will only find data that support your position and fabricate reasons to ignore the data that run counter to what you already believe.\u00a0 If you have a vested interest in a certain decision outcome, then your objectivity is threatened, and the results of your analysis are likely to be biased.<\/p>\n<h1><strong>Informed Decisions Summary<\/strong><\/h1>\n<p>The COVID pandemic has frustrated many of us who believe in data and facts to make informed decisions.\u00a0 Being able to ingest new facts, toss out outdated facts, and ignore the droning of so-called \u201cexpert\u2019s\u201d self-serving and skewed opinions is the key to survival, not only as professionals, but as a species.<\/p>\n<p>Finally, the decision process needs data that users can trust in order to make informed decisions. And having data that one trusts is part of our problem today. Even if the data comes from trustworthy sources, it&#8217;s very easy to take to social media and scream <strong>#FakeNews<\/strong> and create unjustified fear in the data. That&#8217;s why <a href=\"https:\/\/www.linkedin.com\/pulse\/critical-thinking-becoming-students-data-science-bill-schmarzo\/\">Critical Thinking<\/a> is critical to making informed decisions.<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750920086?profile=original\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/9750920086?profile=RESIZE_710x\" class=\"align-full\"><\/a><\/p>\n<p><strong>Figure<\/strong> <strong>6<\/strong><strong>:<\/strong> <a href=\"https:\/\/www.linkedin.com\/pulse\/critical-thinking-becoming-students-data-science-bill-schmarzo\"><strong>The Key Aspects of Critical Thinking<\/strong><\/a><\/p>\n<p>Critical thinking is more important than ever in a world where the media is constantly screaming their point of view (many times just to drive engagement, views, and profits).<\/p>\n<p>The key to your bottom-line (and not someone else\u2019s), is to think for yourself.\u00a0 Period.<\/p>\n<p>\u00a0<\/p>\n<\/p>\n<p><a href=\"http:\/\/feeds.feedburner.com\/FeaturedBlogPosts-DataScienceCentral#_ftnref1\" name=\"_ftn1\"><span>[1]<\/span><\/a> A <strong>hypothesis<\/strong> is an assumption or an idea that is proposed for the sake of argument so that it can be tested to see if it might be true.<\/p>\n<\/div>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/xn\/detail\/6448529:BlogPost:1075305\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: Bill Schmarzo We live in a world where everyone needs to learn how to make informed decisions with incomplete and sometimes conflicting data. And [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2021\/10\/31\/making-informed-decisions-in-imperfect-situations\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":467,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/5162"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=5162"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/5162\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/467"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=5162"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=5162"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=5162"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}