{"id":1647,"date":"2019-01-29T06:37:20","date_gmt":"2019-01-29T06:37:20","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2019\/01\/29\/the-language-of-data-analyzing-the-state-of-the-union\/"},"modified":"2019-01-29T06:37:20","modified_gmt":"2019-01-29T06:37:20","slug":"the-language-of-data-analyzing-the-state-of-the-union","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2019\/01\/29\/the-language-of-data-analyzing-the-state-of-the-union\/","title":{"rendered":"The Language of Data: Analyzing the State of the Union"},"content":{"rendered":"<p>Author: datascience@berkeley Staff<\/p>\n<div>\n<p>Each president\u2019s State of the Union address is an attempt to set the tone for his term in office \u2014 what are the administration\u2019s goals, plans and promises? Those questions dominate the 24-hour news cycle around this yearly address to Congress.<\/p>\n<p>Nearly <a href=\"http:\/\/www.nielsen.com\/us\/en\/insights\/news\/2010\/48-million-watch-president-obamas-first-state-of-the-union-address.html\" target=\"_blank\">50 million people tuned in to watch President Obama\u2019s first State of the Union address<\/a> in 2010. <a href=\"https:\/\/twitter.com\/TwitterGov\/status\/958551545263648768\" target=\"_blank\">President Trump\u2019s speech last year generated more than 4.5 million tweets,<\/a> the most ever for a presidential address.<\/p>\n<p>It\u2019s been more than a century since President Woodrow Wilson\u2019s first State of the Union address, and while the language presidents use to communicate has evolved, many of the words, phrases, and ideas have stood the test of time.\u00a0<\/p>\n<p>Comparing those words, over time, is one way to hold presidencies up against each other, to assess the ways in which presidential communication has changed. How can we objectively compare one State of the Union address to another? Data analysis can be used to transform otherwise dry, static information into comparable statistics that show trends across words, presidents, and years.<\/p>\n<h2>Reading Levels<\/h2>\n<p>One way to compare speeches is to assess their reading levels using the <a href=\"https:\/\/readable.io\/content\/the-flesch-reading-ease-and-flesch-kincaid-grade-level\/\" target=\"_blank\">Flesch-Kincaid grade level test.<\/a> The Flesch-Kincaid readability tests are designed to indicate how difficult a passage is to understand.<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/c8e8ce766d0e4e42bb0b9b537d69c418\/state-of-the-union-reading-levels.png\" target=\"_blank\"> <img decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/c8e8ce766d0e4e42bb0b9b537d69c418\/state-of-the-union-reading-levels.png\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/reading-level\/accessible\/\" target=\"_blank\">Read the text-only version of <em>Reading Level of State of the Union Addresses.<\/em><\/a><\/p>\n<h2>State of the Union Word Analysis<\/h2>\n<p>The data from speeches can be used to compare more than just overall values like reading level. For example, it\u2019s easy to predict that the economy will come up in a State of the Union address. But data shows that presidents tend to talk about taxes more than jobs, and jobs more than banks. Also, among presidents since Wilson, Harry Truman talked about the economy the most \u2014 2.9 percent of his speech was made up of words like \u201cbusiness,\u201d \u201cdebt,\u201d and \u201cdollar.\u201d<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/72d6c3ce9ae34208862c0dd3634e797c\/state-of-the-economy.png\" target=\"_blank\"> <img decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/72d6c3ce9ae34208862c0dd3634e797c\/state-of-the-economy.png\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/economy-graphic\/accessible\/\" target=\"_blank\">Read the text-only version of <em>State of the: Economy.<\/em><\/a><\/p>\n<p>Truman is the only president to say \u201crefugees\u201d in his first State of the Union, and Reagan was the first president to say \u201cterrorism\u201d in his.<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/cceaefc96c06403382999d9ca1aec071\/state-of-the-policy.png\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/cceaefc96c06403382999d9ca1aec071\/state-of-the-policy.png\" alt=\"\" width=\"1173\" height=\"1023\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/policy-graphic\/accessible\/\" target=\"_blank\">Read the text-only version of <em>State of the: Policy.<\/em><\/a><\/p>\n<p>President Trump and President George W. Bush are the only ones to mention Guantanamo in their first State of the Union addresses.<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/b9db0409477746ec8b56031b8a6e176e\/state-of-the-military.png\" target=\"_blank\"><img decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/b9db0409477746ec8b56031b8a6e176e\/state-of-the-military.png\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/military-graphic\/accessible\/\" target=\"_blank\">Read the text-only version of <em>State of the: Military.<\/em><\/a><\/p>\n<p>Words like \u201cI\u201d, \u201cme\u201d, and \u201cus\u201d make up a larger percentage of each address, but it varies. For example, President Ronald Reagan said \u201ctogether\u201d more than anyone else \u2014 it was 0.29 percent of his address.<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/2ac7e2eebb7a4a41be36847e1f601ab2\/state-of-the-people.png\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/2ac7e2eebb7a4a41be36847e1f601ab2\/state-of-the-people.png\" alt=\"\" width=\"1173\" height=\"1009\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/people-graphic\/accessible\/\" target=\"_blank\">Read the text-only version of <em>State of the: People.<\/em><\/a><\/p>\n<p>President Trump said \u201cvery\u201d almost twice as frequently as any other president in their first State of the Union address, while President Nixon said \u201cgreat\u201d more than anyone else.<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/16a5f187c5894241a99421fd71c8e1e4\/state-of-the-superlatives.png\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/16a5f187c5894241a99421fd71c8e1e4\/state-of-the-superlatives.png\" alt=\"\" width=\"1173\" height=\"1019\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/superlatives-graphic\/accessible\/\" target=\"_blank\">Read the text-only version of <em>State of the: Superlatives.<\/em><\/a><\/p>\n<p>How often is the rest of the world mentioned in this early-term address? Countries like Libya and Palestine have only ever been mentioned once, while presidents have said \u201cEurope\u201d 54 times in total.<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/f5c26efaa5a74280a279e058e5bc0b9d\/state-of-the-world.png\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/f5c26efaa5a74280a279e058e5bc0b9d\/state-of-the-world.png\" alt=\"\" width=\"1173\" height=\"1023\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/nations-graphic\/accessible\/\" target=\"_blank\">Read the text-only version of <em>State of the: World.<\/em><\/a><\/p>\n<p>Overall, education isn\u2019t talked about as frequently. Of the words listed, President Roosevelt only said \u201ceducation\u201d once, and Wilson mentioned \u201cschools\u201d just one time as well.<\/p>\n<p><a href=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/477b29d0a1d343dca3ab00b0a3b5c35d\/state-of-the-schools.png\" target=\"_blank\"><img decoding=\"async\" src=\"https:\/\/corp-mktg.s3.amazonaws.com\/cask\/prod\/ucb-mids\/content\/477b29d0a1d343dca3ab00b0a3b5c35d\/state-of-the-schools.png\" alt=\"\"><\/a><\/p>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/education-graphic\/accessible\/\" target=\"_blank\">Read the text-only version of <em>State of the: Schools.<\/em><\/a><\/p>\n<div class=\"u--padding-3 u--text-align-center u--margin-bottom-3\" style=\"background-color: #ffffff;\">\n<h2 class=\"h5\">Share this on social media:<\/h2>\n<p><a href=\"https:\/\/www.facebook.com\/sharer\/sharer.php?u=https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/?utm_source=facebook&#038;utm_medium=social&#038;utm_campaign=blog\" target=\"_blank\">Facebook<\/a>\u00a0|\u00a0\u00a0 <a href=\"https:\/\/www.linkedin.com\/shareArticle?mini=true&#038;url=https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/?utm_source=linkedin&#038;utm_medium=social&#038;utm_campaign=blog\" target=\"_blank\">LinkedIn<\/a>\u00a0|\u00a0\u00a0 <a href=\"https:\/\/twitter.com\/home?status=%22The%20Language%20of%20Data%3A%20Analyzing%20the%20State%20of%20the%20Union%22%20from%20%40BerkeleyData%3A%20https%3A\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/%0A\" target=\"_blank\">Twitter<\/a><\/p>\n<\/div>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/data-methodology\/\" target=\"_blank\">View methodology.<\/a><\/p>\n<p><em>Citation for this content: datascience@berkeley, the <\/em><a href=\"http:\/\/datascience.berkeley.edu\/\" target=\"_blank\"><em>online masters in data science<\/em><\/a><em> from UC Berkeley<\/em><\/p>\n<\/div>\n<p><a href=\"https:\/\/datascience.berkeley.edu\/blog\/trump-state-of-the-union-analysis\/\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: datascience@berkeley Staff Each president\u2019s State of the Union address is an attempt to set the tone for his term in office \u2014 what are [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2019\/01\/29\/the-language-of-data-analyzing-the-state-of-the-union\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":1648,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/1647"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=1647"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/1647\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/1648"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=1647"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=1647"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=1647"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}