{"id":3534,"date":"2020-06-06T06:31:03","date_gmt":"2020-06-06T06:31:03","guid":{"rendered":"https:\/\/www.aiproblog.com\/index.php\/2020\/06\/06\/bernouilli-lattice-models-connection-to-poisson-processes\/"},"modified":"2020-06-06T06:31:03","modified_gmt":"2020-06-06T06:31:03","slug":"bernouilli-lattice-models-connection-to-poisson-processes","status":"publish","type":"post","link":"https:\/\/www.aiproblog.com\/index.php\/2020\/06\/06\/bernouilli-lattice-models-connection-to-poisson-processes\/","title":{"rendered":"Bernouilli Lattice Models &#8211; Connection to Poisson Processes"},"content":{"rendered":"<p>Author: Vincent Granville<\/p>\n<div>\n<p>Bernouilli lattice processes may be one of the simplest examples of point processes, and can be used as an introduction to learn about more complex spatial processes that rely on advanced measure theory for their definition. In this article, we show the differences and analogies between Bernouilli lattice processes on the standard rectangular or hexagonal grid, and the Poisson process, including convergence of discrete lattice processes to continuous Poisson process, mainly in two dimensions. We also illustrate that even though these lattice processes are purely random, they don&#8217;t look random when seen with the naked eye.&nbsp;&nbsp;<\/p>\n<p>We discuss basic properties such as the distribution of the number of points in any given area, or the distribution of the distance to the nearest neighbor. Bernouilli lattice processes have been used as models in financial problems, see <a href=\"http:\/\/www.columbia.edu\/~ks20\/FE-Notes\/4700-07-Notes-BLM.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>. Most of the papers on this topic are hard to read, but here we discuss the concepts in simple English. Interesting number theory problems about sums of squares, deeply related to these lattice processes, are also discussed. Finally, we show how to identify if a particular realization is from a Bernouilli lattice process, a Poisson process, or a combination of both.&nbsp;<\/p>\n<p>See below a realization of a Bernouilli process on the regular hexagonal lattice. The main feature of such a process is that the point locations are fixed, not random. But whether a point is &#8220;fired&#8221; or not (that is, marked in blue) is purely random and independent of whether any other point is fired or not. The probability for a point to be fired is a Bernouilly variable of parameter <em>p<\/em>.&nbsp;<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5611712675?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5611712675?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p style=\"text-align: center;\"><strong>Figure 1<\/strong>: realization of Bernouilli hexagonal lattice process<\/p>\n<p>The source code to produce this plot is available <a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5612289683?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>. More sophisticated models, known as <a href=\"https:\/\/en.wikipedia.org\/wiki\/Markov_random_field\" target=\"_blank\" rel=\"noopener noreferrer\">Markov random fields<\/a>, allows for neighboring points to be correlated. They are useful in image analysis, see <a href=\"https:\/\/rss.onlinelibrary.wiley.com\/doi\/abs\/10.1111\/j.2517-6161.1995.tb02044.x\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a> and <a href=\"https:\/\/ieeexplore.ieee.org\/document\/295910\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>.<\/p>\n<p>To the contrary, Poisson processes assume that the point locations are random. The points being fired are uniformly distributed on the plane, and not restricted to integer or grid coordinates. In short, Bernouilli lattice processes are discrete approximations to Poisson processes. Below is an example of a realization of a Poisson process.<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5612415658?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5612415658?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p style=\"text-align: center;\"><span style=\"font-size: 12pt;\"><strong>Figure 2<\/strong>: realization of a Poisson process<\/span><\/p>\n<p><span style=\"font-size: 14pt;\"><strong>1. Definition and Convergence to Poisson Process<\/strong><\/span><\/p>\n<p>We are dealing here with square lattices covering the entire two-dimensional plane. A point of the lattice is a vector (<em>rx<\/em>, <em>ry<\/em>) where <em>x<\/em>, <em>y<\/em> are integers (positive or negative) and <em>r<\/em> a strictly positive real number,&nbsp;called the <em>scale<\/em> of the lattice. A Bernouilli variable is attached to each point: it is equal to 1 with probability <em>p<\/em>, and to 0 with probability 1 &#8211; <em>p<\/em>. A point of the lattice is said to be <em>fired<\/em> if its Bernouilli variable is equal to 1. Such points are marked in blue in all the plots. The Bernouilli variables are independent and have the same parameter <em>p<\/em>: in other words, this 2-parameter lattice process is homogeneous, as <em>p<\/em> does not depend on the location.&nbsp;<\/p>\n<p>We compare these processes to <a href=\"https:\/\/en.wikipedia.org\/wiki\/Poisson_point_process\" target=\"_blank\" rel=\"noopener noreferrer\">homogeneous Poisson process<\/a> of intensity&nbsp;<em>&lambda;<\/em>, covering the entire plane. For Poisson processes, point locations are random, see figure 2. The number of points in any given area <em>D<\/em> has a Poisson distribution with mean <em>&lambda; S<\/em>(<em>D<\/em>), where <em>S<\/em>&nbsp;represents the surface of the area. The distance to the nearest neighbor has the following distribution, <a href=\"https:\/\/mathoverflow.net\/questions\/218751\/nearest-neighbor-for-planar-poisson-is-normally-distributed\" target=\"_blank\" rel=\"noopener noreferrer\">see here<\/a>:&nbsp;<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5621514083?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5621514083?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p><strong>1.1. Poisson approximation to Bernouilli lattice process<\/strong><\/p>\n<p>In the same way that Bernouilli variables are approximated by Poisson variables when <em>p<\/em> is small,&nbsp;Bernouilli processes are approximated by Poisson processes when <em>p<\/em> is small. The parameters <em>p<\/em> and&nbsp;<em>&lambda;<\/em> play the same role.<em>&nbsp;<\/em><\/p>\n<p>The way convergence occurs is very intuitive. Start with a Bernouilli lattice process as pictured in figure 3, with <em>r<\/em> = 1. Reduce <em>r<\/em> by a factor 2 and <em>p<\/em> by a factor 4: see result in figure 4. Keep repeating this step indefinitely, and you end up with figure 2.&nbsp;<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5622438301?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5622438301?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p style=\"text-align: center;\"><strong>Figure 3<\/strong>: Realization of a Bernouilli square lattice process<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5622480272?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5622480272?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p style=\"text-align: center;\"><strong>Figure 4<\/strong>: A more granular version, with smaller <em>r<\/em> and <em>p<\/em><\/p>\n<p><span style=\"font-size: 14pt;\"><strong>2. Properties of Bernouilli lattice processes<\/strong><\/span><\/p>\n<p>As for Poisson processes, two main features are:<\/p>\n<ul>\n<li>the distribution between a point of the lattice and its closest &#8220;blue&#8221; neighbor<\/li>\n<li>the distribution of the number of blue points in any given area.<\/li>\n<\/ul>\n<p>The number <em>N<\/em> of blue points in any given area <em>D<\/em> is a Binomial variable with expectation <em>p<\/em> <em>S<\/em>(<em>D<\/em>), with&nbsp;S(<em>D<\/em>) being the total number of lattice points (blue or not) in <em>D<\/em>. That is,&nbsp;<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5622927901?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5622927901?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p>For any lattice point <em>z<\/em>, let <em>Y<\/em> be the distance to the closest blue neighbor. Let <em>D<\/em> be a circle centered at <em>z<\/em>, with radius <em>y<\/em>. The probability that <em>Y<\/em> is larger than <em>y<\/em> is the probability that there is no blue point in <em>D<\/em>, that is, based on the previous formula:<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5623436266?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5623436266?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p>Note that if <em>z<\/em>&nbsp;is a blue point, it is not considered to be a nearest neighbor to itself.&nbsp;<\/p>\n<p><strong>2.1. More about the Poisson approximation<\/strong><\/p>\n<p>When <em>r<\/em> and <em>p<\/em> get smaller and smaller as discussed in section 1.1, we have convergence to the Poisson process, and <em>S<\/em>(<em>D<\/em>) in the above formula (for Bernouilli lattice processes) tends to the surface area of <em>D<\/em>, that is&nbsp;&nbsp;<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5623865897?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5623865897?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p>Likewise, for the Poisson process, based on the first formula in section 1, when&nbsp;<em>&lambda;<\/em> is small, we have<em>&nbsp;<\/em><\/p>\n<p><em><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5623958680?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5623958680?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/em><\/p>\n<p>Now the analogy with Poisson processes becomes more clear. Also, <em>p<\/em> and <em>&lambda;<\/em> are equivalent, at the limit. Below is the distribution of <em>Y<\/em> for a Bernouilli lattice process with <em>p<\/em> = 0.001.<\/p>\n<p><a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5624255892?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5624255892?profile=RESIZE_710x\" class=\"align-center\"><\/a><\/p>\n<p style=\"text-align: center;\"><strong>Figure 5<\/strong>: Distribution of distance to nearest neighbor: <em>P<\/em>(<em>Y<\/em>&nbsp; &lt;&nbsp; <em>y<\/em>)<\/p>\n<p>It is indistinguishable from that of a Poisson process with&nbsp;<em>&lambda;<\/em> = 0.001.<em>&nbsp;<\/em>There is a major difference though: the distribution is a discrete one for the lattice process, and a continuous one for the Poisson process, but you can&#8217;t tell the difference with the naked eye, for such a small value of <em>p<\/em>.&nbsp;<\/p>\n<p><strong>2.2. Model testing<\/strong><\/p>\n<p>Since Poisson and Bernouilli lattice processes can be quite similar depending on the granularity of the lattice, one might be interested in testing if some observed data fits with either model. An easy test involves computing the empirical distribution of the distance to the nearest neighbor, and check whether it fits the Bernouilli lattice or Poisson theoretical distribution.<\/p>\n<p>For blended models, say a mixture of Poisson and Bernouilli lattice, one can do simulations. Simulations will also allow you to estimate the proportions of Bernouilli versus Poisson in the mixture model.&nbsp;<\/p>\n<p><strong>2.3. Connection to number theory: sums of two squares<\/strong><\/p>\n<p>An interesting result that can easily be derived from the formulas in section 2.1 is the following. The number of (<em>x<\/em>, <em>y<\/em>) solution to <em>x<\/em>^2 + <em>y<\/em>^2&nbsp;<b>&le;<\/b>&nbsp;<em>k<\/em>, where <em>k<\/em> is a positive integer and the unknown&nbsp;<em>x<\/em>, <em>y<\/em> are positive or negative integers, tends to <em>&pi;k<\/em> as <em>k<\/em> tends to infinity. This is known as the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Gauss_circle_problem\" target=\"_blank\" rel=\"noopener noreferrer\">Gauss circle problem<\/a>. So, on average, the equation <em>x<\/em>^2 + <em>y<\/em>^2 = <em>k<\/em> has&nbsp;<em>&pi;<\/em> solutions, though for some <em>k<\/em>, for instance <em>k<\/em> = 1105, it can be much higher (32 in this case).<em>&nbsp;<\/em>Source code to compute the number of solutions is available <a href=\"https:\/\/storage.ning.com\/topology\/rest\/1.0\/file\/get\/5625490871?profile=original\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>. More generally, the number of integer solutions to such inequalities can be approximated by the surface area under the curve using integration techniques, the curve here being&nbsp;<em>x<\/em>^2 + <em>y<\/em>^2&nbsp;<b>&le;<\/b>&nbsp;<em>k.<\/em><\/p>\n<p>More about sums of squares in the context of number theory, can be found&nbsp;<a href=\"https:\/\/mathworld.wolfram.com\/SumofSquaresFunction.html\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>,&nbsp;<a href=\"https:\/\/mathoverflow.net\/questions\/29644\/enumerating-ways-to-decompose-an-integer-into-the-sum-of-two-squares\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>, <a href=\"https:\/\/en.wikipedia.org\/wiki\/Landau%E2%80%93Ramanujan_constant\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>, and <a href=\"https:\/\/en.wikipedia.org\/wiki\/Fermat%27s_theorem_on_sums_of_two_squares\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>.&nbsp;<\/p>\n<p><span style=\"font-size: 14pt;\"><strong>3. Related articles by same author<\/strong><\/span><\/p>\n<p>Here is a selection of articles pertaining to experimental math and probabilistic number theory:<\/p>\n<ul>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/free-book-statistics-new-foundations-toolbox-and-machine-learning\" target=\"_blank\" rel=\"noopener noreferrer\">Statistics: New Foundations, Toolbox, and Machine Learning Recipes<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/fee-book-applied-stochastic-processes\" target=\"_blank\" rel=\"noopener noreferrer\">Applied Stochastic Processes<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/new-probabilistic-approach-to-factoring-big-numbers\" target=\"_blank\" rel=\"noopener noreferrer\">New Probabilistic Approach to Factoring Big Numbers<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/chaos-attractors-in-machine-learning-systems\" target=\"_blank\" rel=\"noopener noreferrer\">Variance, Attractors and Behavior of Chaotic Statistical Systems<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/new-family-of-generalized-gaussian-distributions\" target=\"_blank\" rel=\"noopener noreferrer\">New Family of Generalized Gaussian Distributions<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/a-beautiful-result-in-probability-theory\" target=\"_blank\" rel=\"noopener noreferrer\">A Beautiful Result in Probability Theory<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/two-new-deep-conjectures-in-probabilistic-number-theory\" target=\"_blank\" rel=\"noopener noreferrer\">Two New Deep Conjectures in Probabilistic Number Theory<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/extreme-events-modeling-using-continued-fractions\" target=\"_blank\" rel=\"noopener noreferrer\">Extreme Events Modeling Using Continued Fractions<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/a-strange-family-of-statistical-distributions\" target=\"_blank\" rel=\"noopener noreferrer\">A Strange Family of Statistical Distributions<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/some-fun-with-the-golden-ratio-time-series-and-number-theory\" target=\"_blank\" rel=\"noopener noreferrer\">Some Fun with Gentle Chaos, the Golden Ratio, and Stochastic Number&#8230;<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/fascinating-new-results-in-the-theory-of-randomness\" target=\"_blank\" rel=\"noopener noreferrer\">Fascinating New Results in the Theory of Randomness<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/two-beautiful-mathematical-results-part-2\" target=\"_blank\" rel=\"noopener noreferrer\">Two Beautiful Mathematical Results &#8211; Part 2<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/two-beautiful-mathematical-results\" target=\"_blank\" rel=\"noopener noreferrer\">Two Beautiful Mathematical Results<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/number-theory-nice-generalization-of-the-waring-conjecture\" target=\"_blank\" rel=\"noopener noreferrer\">Number Theory: Nice Generalization of the Waring Conjecture<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/amazing-random-sequences-with-cool-applications\" target=\"_blank\" rel=\"noopener noreferrer\">Fascinating Chaotic Sequences with Cool Applications<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/simple-proof-of-prime-number-theorem\" target=\"_blank\" rel=\"noopener noreferrer\">Simple Proof of the Prime Number Theorem<\/a><\/li>\n<li><a href=\"https:\/\/www.datasciencecentral.com\/profiles\/blogs\/factoring-massive-numbers-a-new-machine-learning-approach\" target=\"_blank\" rel=\"noopener noreferrer\">Factoring Massive Numbers: Machine Learning Approach<\/a><\/li>\n<\/ul>\n<\/div>\n<p><a href=\"https:\/\/www.datasciencecentral.com\/xn\/detail\/6448529:BlogPost:956113\">Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Author: Vincent Granville Bernouilli lattice processes may be one of the simplest examples of point processes, and can be used as an introduction to learn [&hellip;] <span class=\"read-more-link\"><a class=\"read-more\" href=\"https:\/\/www.aiproblog.com\/index.php\/2020\/06\/06\/bernouilli-lattice-models-connection-to-poisson-processes\/\">Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":461,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[26],"tags":[],"_links":{"self":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/3534"}],"collection":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=3534"}],"version-history":[{"count":0,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/posts\/3534\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media\/463"}],"wp:attachment":[{"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=3534"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=3534"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aiproblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=3534"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}