Sometimes we encounter problems for which it\u2019s really hard to write a computer program to solve. For example, let\u2019s say we wanted to program a computer to recognize hand-written digits:<\/p>\n
\n
Source: MNIST handwritten database<\/p>\n <\/a><\/p>\n You could imagine trying to devise a set of rules to distinguish each individual digit. Zeros, for instance, are basically one closed loop. But what if the person didn\u2019t perfectly close the loop. Or what if the right top of the loop closes below where the left top of the loop starts?<\/p>\n A zero that\u2019s difficult to distinguish from a six<\/p>\n In this case, we have difficulty differentiating zeroes from sixes. We could establish some sort of cutoff, but how would you decide the cutoff in the first place? As you can see, it quickly becomes quite complicated to compile a list of heuristics (i.e., rules and guesses) that accurately classifies handwritten digits.<\/p>\n And there are so many more classes of problems that fall into this category. Recognizing objects, understanding concepts, comprehending speech. We don\u2019t know what program to write because we still don\u2019t know how it\u2019s done by our own brains. And even if we did have a good idea about how to do it, the program might be horrendously complicated.<\/p>\n So instead of trying to write a program, we try to develop an algorithm that a computer can use to look at hundreds or thousands of examples (and the correct answers), and then the computer uses that experience to solve the same problem in new situations. Essentially, our goal is to teach the computer to solve by example, very similar to how we might teach a young child to distinguish a cat from a dog.<\/p>\n \n The field itself:<\/strong> ML is a field of study which harnesses principles of computer science and statistics to create statistical models. These models are generally used to do two things:<\/p>\n Difference between ML and AI:<\/strong> There is no universally agreed upon distinction between ML and artificial intelligence (AI). AI usually concentrates on programming computers to make decisions<\/em> (based on ML models and sets of logical rules), whereas ML focuses more on making predictions<\/em> about the future. They are highly interconnected fields, and, for most non-technical purposes, they are the same.<\/p>\n —\u00a0 \u00a0—\u00a0 \u00a0—<\/p>\n Models:<\/strong> Teaching a computer to make predictions involves feeding data into machine learning models<\/strong>, which are representations of how the world supposedly works. If I tell a statistical model that the world works a certain way (say, for example, that taller people make more money than shorter people), then this model can then tell me who it thinks will make more money, between Cathy, who is 5\u20192\u201d, and Jill, who is 5\u20199\u201d.<\/p>\n What does a model actually look like? Surely the concept of a model makes sense in the abstract, but knowing this is just half of the battle. You should also know how it\u2019s represented inside of a computer, or what it would look like if you wrote it down on paper.<\/p>\n A model is just a mathematical function, which, as you probably already know, is a relationship between a set of inputs and a set of outputs. Here\u2019s an example:<\/p>\n f(x) = x\u00b2<\/em><\/p>\n This is a function that takes as input a number and returns that number squared. So, f(1) = 1, f(2) = 4, f(3) = 9.<\/p>\n Let\u2019s briefly return to the example of the model that predicts income from height. I may believe, based on what I\u2019ve seen in the corporate world, that a given human\u2019s annual income is, on average, equal to her height (in inches) times 1,000. So, if you\u2019re 60 inches tall (5 feet), then I\u2019ll guess that you probably make $60,000 a year. If you\u2019re a foot taller, I think you\u2019ll make $72,000 a year.<\/p>\n This model can be represented mathematically as follows:<\/p>\n Income = Height \u00d7 $1,000<\/em><\/p>\n In other words, income is a function of height.<\/p>\n Here\u2019s the main point:<\/em><\/strong> Machine learning refers to a set of techniques for estimating functions (like the one involving income) based on datasets (pairs of heights and their associated incomes). These functions, which are called models, can then be used for predictions of future\u00a0data.<\/em><\/span><\/p><\/blockquote>\n Algorithms:<\/strong> These functions are estimated using algorithms<\/strong>. In this context, an algorithm is a predefined set of steps that takes as input a bunch of data and then transforms it through mathematical operations. You can think of an algorithm like a recipe\u200a\u2014\u200afirst do this<\/em>, then do that<\/em>, then do this<\/em>. Done.<\/p>\n Machine learning of all types uses models and algorithms as its building blocks to make predictions and inferences about the world.<\/p>\n To explain what is being learnt<\/em> in machine learning, let\u2019s start with an example application, spam classification. One approach to write a computer program to classify spam emails from non-spam emails, is to split each email into individual words and maintain a list of words that appear more frequently in spam emails. For example, some example of such words might be \u2018loan\u2019, \u2018$\u2019, \u2018credit\u2019, \u2018discount\u2019, \u2018offer\u2019, \u2018password\u2019, \u2018viagra\u2019, and so on. Then, if an email has a substantial number of these words, it should be classified as spam.<\/p>\n Although the strategy above might give fairly good results (say detect spam with an accuracy of 80%), the accuracy depends in large part on the list of words we maintain, and on the precise threshold we choose to classify an email as spam.<\/p>\n In machine learning, the strategy is to learn the list of words and the threshold from examples. In fact, in addition to which words are bad words, we could also learn how<\/em> bad each word is. (This example is quite realistic, and is how many spam classification algorithms work.)<\/p>\n So in this case, the thing being learnt is, a notion of how bad each word is. Note that that is not the only way to frame the problem, we framed the problem in this way because we noticed a pattern that spam emails often contain specific words, and then we came up with a strategy that would analyze every<\/strong> possible word as a possible suspect. This strategy might give inaccurate results for other tasks, or be too inefficient.<\/p>\n \n You might notice that using machine learning to learn how bad each word is has many desirable properties over maintaining this list manually.<\/p>\n —\u00a0 \u00a0—\u00a0 \u00a0—<\/p>\n Co-authored by Noah Yonack, Keshav Dhandhania and Nikhil Buduma.<\/em><\/p>\n Originally published here<\/a><\/em>.\u00a0<\/p>\n<\/div>\n Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<\/a><\/p>\n
<\/a><\/p>\n
What is Machine Learning?\u200a\u2014\u200aDefinition<\/h2>\n
\n
<\/a><\/p>\n
What\u2019s a statistical model?<\/h2>\n
What exactly is being\u00a0learnt<\/h2>\n
Desirable properties of machine\u00a0learning<\/h2>\n
\n