{"id":575,"date":"2018-06-03T06:58:50","date_gmt":"2018-06-03T06:58:50","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2018\/06\/03\/free-book-applied-stochastic-processes\/"},"modified":"2018-06-03T06:58:50","modified_gmt":"2018-06-03T06:58:50","slug":"free-book-applied-stochastic-processes","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2018\/06\/03\/free-book-applied-stochastic-processes\/","title":{"rendered":"Free Book: Applied Stochastic Processes"},"content":{"rendered":"<p>Author: Vincent Granville<\/p>\n<div>\n<p><span style=\"font-size: 12pt;\">Full title: <em>Applied Stochastic Processes, Chaos Modeling, and Probabilistic Properties of Numeration Systems<\/em>. Published June 2, 2018. Author: Vincent Granville, PhD. (104 pages, 16 chapters.)<\/span><\/p>\n<p><span style=\"font-size: 12pt;\">This book is intended to professionals in data science, computer science, operations research, statistics, machine learning, big data, and mathematics. In 100 pages, it covers many new topics, offering a fresh perspective on the subject. It is accessible to practitioners with a two-year college-level exposure to statistics and probability. The compact and tutorial style, featuring many applications (Blockchain, quantum algorithms, HPC, random number generation, cryptography, Fintech, web crawling, statistical testing) with numerous illustrations, is aimed at practitioners, researchers and executives in various quantitative fields.<\/span><\/p>\n<p><span style=\"font-size: 12pt;\"><a href=\"http:\/\/api.ning.com\/files\/CDU-2PoeH6QL59VbutPY3gfauFigHvxp-W***7EvE8CSAAkPRxclPHjC0vp2k7x5xq9usL-RBvb5VpM0Fl1PI5v3z1ABZ2*g\/Capture.PNG\" target=\"_self\"><img decoding=\"async\" src=\"http:\/\/api.ning.com\/files\/CDU-2PoeH6QL59VbutPY3gfauFigHvxp-W***7EvE8CSAAkPRxclPHjC0vp2k7x5xq9usL-RBvb5VpM0Fl1PI5v3z1ABZ2*g\/Capture.PNG\" width=\"298\" class=\"align-center\"><\/a><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">New ideas, advanced topics, and state-of-the-art research are discussed in simple English, without using jargon or arcane theory. It unifies topics that are usually part of different fields (data science, operations research, dynamical systems, computer science, number theory, probability) broadening the knowledge and interest of the reader in ways that are not found in any other book. This short book contains a large amount of condensed material that would typically be covered in 500 pages in traditional publications. Thanks to cross-references and redundancy, the chapters can be read independently, in random order.<\/span><\/p>\n<p><span style=\"font-size: 12pt;\">This book is available for Data Science Central members exclusively. The text in blue consists of clickable links to provide the reader with additional references. \u00a0Source code and Excel spreadsheets summarizing computations, are also accessible as hyperlinks for easy copy-and-paste or replication purposes. The most recent version of this book is available <a href=\"https:\/\/www.datasciencecentral.com\/page\/free-books-1\">from this link<\/a>, accessible to DSC members only.\u00a0<\/span><\/p>\n<p><span style=\"font-size: 12pt;\"><strong>About the author<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">Vincent Granville is a start-up entrepreneur, patent owner, author, investor, pioneering data scientist with 30 years of corporate experience in companies small and large (eBay, Microsoft, NBC, Wells Fargo, Visa, CNET) and a former VC-funded executive, with a strong academic and research background including Cambridge University.<\/span><\/p>\n<p><span style=\"font-size: 12pt;\"><a href=\"https:\/\/www.datasciencecentral.com\/page\/free-books-1\" target=\"_blank\" rel=\"noopener\">Click here<\/a> to get the book. For Data Science Central members only.<\/span><\/p>\n<p><span style=\"font-size: 12pt;\"><strong>Content<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">The book covers the following topics:<\/span><span style=\"font-size: 12pt;\">\u00a0<\/span><\/p>\n<p><span style=\"font-size: 12pt;\"><strong>1. Introduction to Stochastic Processes<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">We introduce these processes, used routinely by Wall Street quants, with a simple approach consisting of re-scaling \u00a0random \u00a0walks to make them time-continuous, with a finite variance, based on the central limit theorem.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Construction of Time-Continuous Stochastic Processes<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">From Random Walks to Brownian Motion<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Stationarity, Ergodicity, Fractal Behavior<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Memory-less or Markov Property<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Non-Brownian Process<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>2. Integration, Differentiation, Moving Averages<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">We introduce more advanced concepts about stochastic processes. Yet we make these concepts easy to understand even to the non-expert. This is a follow-up to Chapter 1.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Integrated, Moving Average and Differential Process<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Proper Re-scaling and Variance Computation<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Application to Number Theory Problem<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>3. Self-Correcting Random Walks<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">We investigate here a breed of stochastic processes that are different from the Brownian motion, yet are better models in many contexts, including Fintech.<\/span><span style=\"font-size: 12pt;\">\u00a0<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Controlled or Constrained Random Walks<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Link to Mixture Distributions and Clustering<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">First Glimpse of Stochastic Integral Equations<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Link to Wiener Processes, Application to Fintech<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Potential Areas for Research<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Non-stochastic Case<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>4. Stochastic Processes and Tests of Randomness<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">In this transition chapter, we introduce a different type of stochastic process, with number theory and cryptography applications, analyzing statistical properties of numeration systems along the way &#8212; a recurrent theme in the next chapters, offering many research opportunities and applications. While we are dealing with deterministic sequences here, they behave very much like stochastic processes, and are treated as such. Statistical testing is central to this chapter, introducing tests that will be also used in the last chapters.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Gap Distribution in Pseudo-Random Digits<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Statistical Testing and Geometric Distribution<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Algorithm to Compute Gaps<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Another Application to Number Theory Problem<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Counter-Example: Failing the Gap Test<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>5. Hierarchical Processes<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">We start discussing random number generation, and numerical and computational issues in simulations, applied to an original type of stochastic process. This will become a recurring theme in the next chapters, as it applies to many other processes.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Graph Theory and Network Processes<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">The Six Degrees of Separation Problem<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Programming Languages Failing to Produce Randomness in Simulations<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">How to Identify and Fix\u00a0 the Previous Issue<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Application to Web Crawling<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>6. Introduction to Chaotic Systems<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">While typically studied in the context of dynamical systems, the logistic map can be viewed \u00a0as a stochastic process, with an equilibrium distribution and probabilistic properties, just like numeration systems (next chapters) and processes introduced in the first four chapters.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Logistic Map and Fractals<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Simulation: Flaws in Popular Random \u00a0Number \u00a0Generators<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Quantum Algorithms<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>7. Chaos, Logistic Map and Related Processes<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">We study processes related to the logistic map, including a special logistic map discussed here for the first time, with a simple equilibrium distribution. This chapter offers a transition between chapter 6, and the next chapters on numeration system (the logistic map being one of them.)<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">General Framework<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Equilibrium Distribution and Stochastic Integral Equation<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Examples of Chaotic Sequences<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Discrete, Continuous Sequences and Generalizations<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Special Logistic Map<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Auto-regressive Time Series<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Literature<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Source Code with Big Number Library<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Solving the Stochastic Integral Equation: Example<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>8. Numerical and Computational Issues<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">These issues have been mentioned in chapter 7, and also appear in chapters 9, 10 and 11. Here we take a deeper dive and offer solutions, using high precision computing with BigNumber libraries.\u00a0<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Precision Issues when Simulating, Modeling, and Analyzing Chaotic Processes<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">When Precision Matters, and when it does not<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">High Precision Computing (HPC)<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Benchmarking HPC Solutions<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">How to Assess the Accuracy of your Simulation Tool<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>8. Digits of Pi, Randomness, and Stochastic Processes<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">Deep mathematical and data science research (including a result about the randomness of\u00a0 p, which is just a particular case) are presented here, without using arcane terminology or complicated equations.\u00a0 Numeration systems discussed here are a particular case of deterministic sequences behaving just like the stochastic process investigated earlier, in particular the logistic map, which is a particular case.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Application: Random Number Generation<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Chaotic Sequences Representing Numbers<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Data Science and Mathematical Engineering<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Numbers in Base 2, 10, 3\/2 or p<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Nested Square Roots and Logistic Map<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">About the Randomness of the Digits of p<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">The Digits of p are Randomly Distributed in the Logistic Map System<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Paths to Proving Randomness in the Decimal System<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Connection with Brownian Motions<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Randomness and the Bad Seeds Paradox<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Application to Cryptography, Financial Markets, Blockchain, and HPC<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Digits of p in Base p<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>10. Numeration Systems in One Picture<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">Here you will find a summary of much of the material previously covered on chaotic systems, in the context of numeration systems (in particular, chapters 7 and \u00a09.)<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Summary Table: Equilibrium Distribution, Properties<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Reverse-engineering Number Representation Systems<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Application to Cryptography<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>11. Numeration Systems: More Statistical Tests and Applications<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">In addition to featuring new research results and building on the previous chapters, the topics discussed here offer a great sandbox for data scientists and mathematicians.<\/span><span style=\"font-size: 12pt;\">\u00a0<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Components of Number Representation Systems<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">General Properties of these Systems<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Examples of Number Representation Systems<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Examples of Patterns in Digits Distribution<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Defects found in the Logistic Map System<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Test of Uniformity<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">New Numeration System with no Bad Seed<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Holes, Autocorrelations, and Entropy (Information Theory)<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Towards a more General, Better, Hybrid System<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Faulty Digits, Ergodicity, and High Precision Computing<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Finding the Equilibrium Distribution with the Percentile Test<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Central Limit Theorem, Random Walks, Brownian Motions, Stock Market Modeling<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Data Set and Excel Computations<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>12. The Central Limit Theorem Revisited<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">The central limit theorem explains the convergence of discrete stochastic processes to Brownian motions, and has been cited a few times in this book. Here we also explore a version that applies to deterministic sequences. Such sequences and treated as stochastic processes in this book.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">A Special Case of the Central Limit Theorem<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Simulations, Testing, and Conclusions<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Generalizations<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Source Code<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>13. How to Detect if Numbers are Random or Not<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">We explore here some deterministic sequences of numbers, behaving like stochastic processes or chaotic systems, together with another interesting application of the central limit theorem.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Central Limit Theorem for Non-Random Variables<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Testing Randomness: Max Gap, Auto-Correlations and More<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Potential Research Areas<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Generalization to Higher Dimensions<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>14. Arrival Time of Extreme Events in Time Series<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">Time series, as discussed in the first chapters, are also stochastic processes. Here we discuss a topic rarely investigated in the literature: the arrival times, as opposed to the extreme values (a classic topic), associated with extreme events in time series.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">Simulations<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Theoretical Distribution of Records over Time<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>15. Miscellaneous Topics<\/strong><\/span><\/p>\n<p><span style=\"font-size: 12pt;\">We investigate topics related to time series as well as other popular stochastic processes such as spatial processes.<\/span><\/p>\n<ul>\n<li><span style=\"font-size: 12pt;\">How and Why: Decorrelate Time Series<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">A Weird Stochastic-Like, Chaotic Sequence<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Stochastic Geometry, Spatial Processes, Random Circles: Coverage Problem<\/span><\/li>\n<li><span style=\"font-size: 12pt;\">Additional Reading (Including Twin Points in Point Processes)<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 12pt;\"><strong>16. Exercises<\/strong><\/span><\/p>\n<\/div>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/xn\/detail\/6448529:BlogPost:726571\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: Vincent Granville Full title: Applied Stochastic Processes, Chaos Modeling, and Probabilistic Properties of Numeration Systems. Published June 2, 2018. Author: Vincent Granville, PhD. (104 [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2018\/06\/03\/free-book-applied-stochastic-processes\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":576,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/575"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=575"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/575\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/576"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=575"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=575"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=575"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}