Author: anatoly

  • The Population Model That Fails—and Why Its Equation Is Everywhere: Population, Interest, and Radioactive Decay

    “`html

    A remarkably simple differential equation appears in many different places in the real world. We will begin with population growth. The first model we try will have a serious problem: it predicts unlimited growth. Fixing that problem will lead us to the logistic equation.

    Then, surprisingly, we will return to our original equation and discover that it was not a bad equation at all. The same equation describes continuous compound interest, radioactive decay, and many other processes.

    1. The Simplest Population Model

    Let P(t) denote a population at time t.

    One of the simplest assumptions we can make is this: the rate at which the population grows is proportional to the population itself.

    dP dt = kP, P(0) = P0.

    Here k>0 is a constant. The idea seems reasonable. If there are twice as many individuals, we might expect approximately twice as many births. A larger population therefore grows faster.

    The equation is separable:

    dPP = kdt.

    Integrating gives

    lnP = kt+C,

    and therefore

    P(t) = P0 ekt.

    This is exponential growth.

    There is an immediate problem. If k>0, then

    P(t) → ∞ as t→∞.

    According to this model, the population eventually becomes arbitrarily large. That cannot continue indefinitely in the real world. Food, water, space, and other resources are limited.

    So our first population model is useful for describing growth over some periods, but it cannot be the whole story.

    “`
    “`html

    2. Introducing a Carrying Capacity

    Suppose the environment can sustainably support a maximum population K. This number is called the carrying capacity.

    We modify our original equation to

    dP dt = kP ( 1 − P K )

    This is the logistic equation.

    The new factor

    ( 1 − P K )

    is what changes everything. When the population is small compared with K, this factor is close to 1, so the population behaves approximately like ordinary exponential growth. As the population becomes larger, the factor becomes smaller and the growth slows down.

    We Can Predict the Solutions Without Solving the Equation

    This is one of the most useful ideas in differential equations: we do not always need an explicit formula to understand what the solutions will do.

    First suppose

    0 < P < K.

    Then

    ( 1 − P K ) > 0,

    and consequently

    dP dt > 0.

    So the population increases.

    Now suppose P=K. Then

    ( 1 − P K ) = 0,

    so

    dP dt = 0.

    The population remains constant at the carrying capacity.

    Finally, if P>K, then

    ( 1 − P K ) < 0,

    and therefore

    dP dt < 0.

    The population decreases toward the carrying capacity.

    Where Is the Population Growing Fastest?

    The growth rate is

    kP ( 1 − P K ).

    As a function of P, this is a downward-opening quadratic:

    kP − kP2 K .

    Its maximum occurs at

    P = K 2 .

    This tells us something important about the shape of the population curve.

    If P0 < K2 , the population initially grows faster and faster. When it reaches P = K2 , its growth rate is greatest. After that, the population continues to increase, but more and more slowly as it approaches K. This produces the familiar S-shaped logistic curve.

    If K2 < P0 < K , the population begins above the point of fastest growth. It still increases toward K, but it slows down from the beginning.

    Finally, if P0 > K , the population decreases toward K.

    Thus, before solving the logistic equation, we can already predict the three different types of solution curves shown in the next figure.

    “`
    “`html id=”p87fcf”

    3. Now Let Us Solve the Logistic Equation

    We now return to the logistic equation

    dP dt = kP ( 1 − P K ), P(0) = P0.

    We have already learned a great deal about its solutions without solving it. Now let us find the actual formula.

    First separate the variables:

    dP P ( 1 − P K ) = kdt.

    Since

    1 P ( 1 − P K ) = 1P + 1 K−P ,

    we can integrate:

    ∫ ( 1P + 1 K−P ) dP = ∫ kdt.

    This gives

    lnP − ln ( K−P ) = kt + C.

    Combining the logarithms,

    ln ( P K−P ) = kt + C.

    Exponentiating both sides gives

    P K−P = C e kt .

    Using the initial condition P(0) = P0 , we obtain

    C = P0 K − P0 .

    After solving for P, we obtain the logistic growth formula:

    P(t) = K 1 + K − P0 P0 e −kt .

    Now the formula confirms what we predicted from the differential equation. For positive initial populations, the population approaches the carrying capacity:

    P(t) → K as t→∞.

    So the carrying capacity is not merely a number inserted into the model. It becomes the long-term population predicted by the model.

    4. Was Our Original Equation Really So Bad?

    We rejected the equation

    dy dt = ky

    as a model of population growth over an unlimited period of time. But the equation itself is one of the most important differential equations in mathematics.

    The initial-value problem

    dy dt = ky, y(0) = y0

    has the solution

    y(t) = y0 e kt .

    What changes from one application to another is the meaning of y and the sign and meaning of the proportionality constant.

    5. Continuous Compound Interest

    Suppose an amount of money A(t) earns interest continuously at an annual rate r. The rate at which the account balance changes is proportional to the amount currently in the account:

    dA dt = rA, A(0) = A0.

    Therefore,

    A(t) = A0 e rt .

    The same equation that produced exponential population growth now describes the growth of money.

    6. Radioactive Decay

    Now consider a radioactive substance. The more radioactive nuclei that are present, the more nuclei are available to decay. Thus, the magnitude of the decay rate is proportional to the amount currently present.

    This time the quantity is decreasing, so we write

    dN dt = − λN, N(0) = N0,

    where λ>0 is the decay constant.

    The solution is

    N(t) = N0 e − λt .

    7. One Equation, Many Processes

    We began with perhaps the simplest population model imaginable: the rate of change of a population is proportional to the population itself.

    As a long-term population model, it failed. Unlimited exponential population growth is impossible in an environment with limited resources.

    Introducing a carrying capacity led naturally to the logistic equation. Even more importantly, we were able to predict the behavior of its solutions before solving the equation.

    But our original equation was far from useless. The same basic mathematical law appears in continuous compound interest and radioactive decay.

    The common idea is simple:

    The rate of change of a quantity is proportional to the amount of that quantity currently present.

    Population, money, and radioactive atoms seem like completely different things. Mathematically, however, they can obey the same law.

    That is one of the remarkable features of differential equations: the same mathematical equation can describe very different processes in the real world.


    Related: See another example where a simple mathematical model produces a surprising—and ultimately unrealistic—prediction: A Sliding Ladder: Is It Better to Slide or Jump? .

  • How Do You Fit a Cylinder to Thousands of Points in Real Time?

    Several years ago, I was given a practical geometry problem:

    Given thousands of measured points in three-dimensional space, find the cylinder that best fits them.

    There was an additional requirement that made the problem much more interesting. The calculation had to be fast enough to operate in real time.

    This meant that simply defining a mathematically reasonable fitting problem was not enough. The equations had to be arranged so that thousands of data points could be processed efficiently, the derivatives could be evaluated quickly, and each optimization step would require solving only a very small system of equations.

    The resulting method combines geometry, calculus, least squares, and the Gauss–Newton method.

    The Geometry of a Cylinder

    Suppose that

    X = ( x1 , x2 , x3 ) T

    is a point on the axis of a cylinder, and

    U = ( u1 , u2 , u3 ) T

    is a vector pointing along the axis.

    Let P be a point on the surface of the cylinder.

    The defining geometric property is simple:

    The perpendicular distance from every point on the cylinder to its axis is the radius r.

    Distance from a Point to the Axis

    Consider the vector

    P−X.

    Part of this vector points along the cylinder axis, while the remaining part is perpendicular to the axis.

    If α is the angle between P−X and U, then

    ‖P−X‖ sinα = r.

    Squaring gives

    ‖P−X‖ 2 sinα2 = r2.

    The dot product gives

    ( (P−X) T U ) 2 = ‖P−X‖ 2 ‖U‖ 2 cosα2 .

    Combining these relations eliminates the angle completely and gives

    ‖P−X‖ 2 − ( (P−X) T U ) 2 ‖U‖ 2 = r2 .

    This is the equation we need.

    The first term measures the squared distance from X to P. The fraction subtracts the squared component parallel to the axis. What remains is exactly the squared perpendicular distance to the axis.

    Turning the Geometry into a Residual

    Measured points will not lie exactly on a perfect cylinder.

    For a measured point P, define

    R(P) = ‖P−X‖ 2 − ( (P−X) T U ) 2 ‖U‖ 2 − r2 .

    For a point exactly on the cylinder,

    R(P) =0.

    For a noisy measured point, the residual will usually be nonzero.

    Reducing the Number of Unknowns

    At first the cylinder appears to have seven parameters: three coordinates for a point on its axis, three coordinates for the axis direction, and the radius.

    But there is redundancy.

    Moving the reference point X along the axis does not change the cylinder. Also, multiplying U by a nonzero constant does not change its direction.

    Assuming the cylinder axis is not parallel to the ( x1 , x2 ) plane, choose

    X = ( x1 , x2 , 0 ) T , U = ( u1 , u2 , 1 ) T .

    Now the entire cylinder is described by only five unknown numbers:

    S = ( x1 , x2 , u1 , u2 , r ) T .

    Two numbers locate the axis, two determine its direction, and one gives the radius.

    From Geometry to Least Squares

    Suppose our measuring system produces m points:

    P1 , P2 , … , Pm .

    Each point produces a residual Rj .

    We find the best-fitting cylinder by minimizing

    f(S) = 12 ∑ j=1 m R j 2 .

    This is a nonlinear least-squares problem.

    Why the Derivatives Matter

    Because the calculation had to run quickly, I derived the residual derivatives analytically.

    For each measured point, we need derivatives with respect to the five unknown parameters:

    ∇R = ( ∂R ∂x1 , ∂R ∂x2 , ∂R ∂u1 , ∂R ∂u2 , ∂R ∂r ) .

    The formulas contain several repeated expressions. In an implementation, there is no reason to calculate the same quantity over and over.

    For example, define

    q = (p1 −x1) u1 + (p2 −x2) u2 + p3 u12 + u22 + 1 .

    Then several derivative formulas become much shorter and faster to evaluate.

    This may look like a minor algebraic simplification on paper. In a real-time numerical algorithm that evaluates the same expressions thousands of times, such simplifications matter.

    The Jacobian

    Collect all the residuals into the vector

    E = ( R1 , R2 , … , Rm ) T .

    The Jacobian J has one row for every measured point and one column for every unknown parameter.

    Therefore,

    J is an m×5 matrix.

    Gauss–Newton

    The least-squares objective can be written compactly as

    f = 12 ‖E‖ 2 .

    Its gradient is

    ∇f = JTE .

    Gauss–Newton approximates the Hessian by

    ∇2f ≈ JTJ .

    At each iteration, instead of solving the original nonlinear problem from scratch, we solve

    JT J G = − JT E .

    The vector G tells us how to change the current estimate of the cylinder.

    Why Thousands of Points Are Not as Bad as They Sound

    This is the computational feature that makes the method especially attractive.

    Suppose the measuring system gives us 10,000 points.

    Then J has 10,000 rows.

    But it still has only five columns.

    Therefore,

    JTJ

    is only a

    5×5

    matrix.

    And

    JTE

    contains only five numbers.

    So although every iteration uses information from thousands of measured points, the linear system that determines the next step has only five unknowns.

    That is a very useful structure for a real-time calculation.

    Do Not Always Take the Full Step

    A Gauss–Newton direction tells us which way to move, but taking the entire step is not always wise.

    Write the update as

    Sk+1 = Sk + ak Gk , 0 < ak ≤ 1 .

    The step length is chosen adaptively. Start with ak=1 and reduce it if necessary until the new point produces a sufficient decrease in the objective function.

    In practice, the full step can often be accepted, but the line search gives the algorithm additional protection when the current estimate is not yet close to the solution.

    When Do We Stop?

    At a minimum we expect

    ∇f = 0 .

    Numerically, we stop when

    ‖∇f‖ < ε ,

    where ε is a small tolerance.

    There is no benefit in demanding far more numerical precision than the data and the computer arithmetic can support. An unnecessarily small tolerance can even create numerical difficulties.

    Did It Work?

    Yes.

    This was not a numerical example invented after the fact. The cylinder fitting problem came from a real application, and the algorithm had to work fast enough for real-time use.

    The implementation worked extremely well.

    What I found especially satisfying was that the final algorithm was built from familiar mathematical ingredients:

    geometry  →  least squares  →  calculus  →  Gauss–Newton  →  real-time computation.

    The important part was arranging those ingredients in the right way.

    From Cylinders to Cones

    A cylinder has constant radius. Once this fitting method works, a natural question is:

    What happens if the radius changes as we move along the axis?

    That leads to a cone.

    The cone-fitting problem requires one additional parameter—the opening angle—and the derivatives become more complicated. But the central strategy remains the same:

    choose an efficient geometric residual  →  derive its Jacobian  →  form a nonlinear least-squares problem  →  solve it with Gauss–Newton.

    That will be the subject of the next post.

    The Larger Lesson

    There is an important distinction between solving a mathematical problem and solving it in a form that is useful in practice.

    With 10,000 measured points, the original problem sounds large. But the geometry allows the unknown cylinder to be represented by only five parameters. Gauss–Newton then converts each iteration into a small five-variable linear problem.

    This is one of the recurring ideas in applied mathematics:

    A good mathematical formulation can be as important as the algorithm itself.

    When the formulation is right, a problem involving thousands of three-dimensional measurements can become small enough to solve in real time.


    A Closely Related Fitting Problem

    Cylinder fitting is only one version of the real-time surface-fitting problem. A closely related challenge arises when the measured surface is a cone rather than a cylinder.

    The change in geometry leads to a different mathematical problem, but the objective is the same: use the structure of the surface to obtain an accurate fit quickly enough for practical real-time computation.

    Continue exploring: How Do You Fit a Cone to Thousands of Points in Real Time?

  • How Do You Fit a Cone to Thousands of Points in Real Time?

    Several years ago, I was given an applied mathematics problem that sounded simple at first:

    Given thousands of measured points in three-dimensional space, find the cone that best fits them.

    But there was an additional requirement that changed the problem completely. The calculation had to be fast enough to be used in real time.

    It is one thing to describe an optimization problem mathematically. It is another thing to solve it repeatedly, quickly, and reliably while a real system is operating.

    The solution came from combining elementary geometry with nonlinear least squares and the Gauss–Newton method.

    The Geometric Problem

    Suppose a collection of measured points

    P1 , P2 , … , Pm

    lies close to the surface of an unknown right circular cone.

    We want to determine three things:

    the vertex of the cone, the direction of its axis, and its opening angle.

    Let

    X = ( x1 , x2 , x3 )

    be the vertex, let U point along the axis, and let α be the half-angle of the cone.

    If P lies exactly on the cone, then the vector

    P−X

    makes angle α with the cone axis.

    The dot-product formula for the angle between two vectors therefore gives

    ( (P−X) T U ) 2 = ‖P−X‖ 2 ‖U‖ 2 cosα2 .

    This one equation contains the geometry of the cone.

    Turning Geometry into an Error

    Measured data will not lie exactly on a perfect cone. There will be noise, measurement error, and small deviations from the ideal surface.

    So instead of asking whether a point satisfies the cone equation exactly, we measure how far it is from satisfying the equation.

    Define the residual

    R (P) = ‖P−X‖ 2 cosα 2 − ( (P−X) T U ) 2 ‖U‖ 2 .

    For a point exactly on the cone,

    R(P) =0.

    For a measured point near the cone, the residual will generally be nonzero.

    Why Use This Residual?

    There is an important practical point here.

    One could try to calculate the exact shortest geometric distance from every measured point to the cone. But when thousands of points must be processed repeatedly in real time, the computational form of the problem matters.

    The residual above is obtained directly from the cone equation. It can be evaluated using additions, multiplications, dot products, and a few simple functions.

    This was exactly what was needed for the application: a mathematical description that could be differentiated explicitly and evaluated rapidly.

    Six Unknown Parameters

    The direction of the axis does not depend on the length of U. Multiplying the axis vector by a nonzero constant gives the same axis.

    Assuming the axis is not parallel to the (x1, x2) plane, we can therefore write

    U = ( u1 , u2 , 1 ) .

    The entire cone is then described by only six unknown numbers:

    S = ( x1 , x2 , x3 , u1 , u2 , α ) T .

    Three numbers locate the vertex, two determine the axis direction, and one determines the cone angle.

    From One Point to Thousands of Points

    Suppose there are m measured points.

    For each point Pj , compute a residual Rj .

    We then look for the cone that minimizes the total squared residual:

    f(S) = 12 ∑ j=1 m R j 2 .

    This is a nonlinear least-squares problem.

    Why Not Just Solve the Equations?

    If the measurements were perfect, six carefully chosen points might appear to be enough to determine six unknown parameters.

    Real data do not work that way.

    Measurements contain noise, and a small collection of points may give a poor estimate. Instead, we can use hundreds or thousands of points simultaneously and find the cone that best fits all of them.

    But now the equations are nonlinear. There is no simple matrix formula that immediately gives the answer.

    This is where Gauss–Newton enters the story.

    The Jacobian

    Put all the residuals into one vector:

    E = ( R1 , R2 , … , Rm ) T .

    Then

    f = 12 ‖E‖ 2 .

    The Jacobian J contains the derivatives of every residual with respect to the six cone parameters.

    Its j-th row is

    Jj = ( ∂Rj ∂x1 , ∂Rj ∂x2 , ∂Rj ∂x3 , ∂Rj ∂u1 , ∂Rj ∂u2 , ∂Rj ∂α ) .

    In the actual implementation, these derivatives were derived analytically rather than estimated numerically.

    That requires more work at the beginning, but once the formulas are known, they can be evaluated very efficiently.

    The Key Gauss–Newton Approximation

    The gradient of the least-squares objective has a particularly simple form:

    ∇f = JT E .

    The exact Hessian is

    ∇2f = JTJ + ∑ j=1 m Rj ∇2 Rj .

    Computing the second term repeatedly is considerably more expensive.

    Gauss–Newton makes the approximation

    ∇2f ≈ JTJ .

    This approximation becomes especially natural when the fit is already good, because the residuals Rj are then small.

    That observation was crucial for a real-time implementation. Instead of constructing the complete second derivative at every iteration, we can work primarily with the Jacobian.

    One Iteration

    At the current estimate Sk , the Gauss–Newton direction Gk is obtained by solving

    JkT Jk Gk = − JkT Ek .

    Then update the six cone parameters:

    Sk+1 = Sk + ak Gk .

    Here 0<ak≤1 is the step length.

    Why Use a Line Search?

    Taking the full Gauss–Newton step is not always a good idea when the current estimate is still far from the solution.

    The implementation therefore reduces the step when necessary until the objective function decreases sufficiently.

    In mathematical form, choose the step length so that

    f ( Sk + ak Gk ) ≤ f (Sk) + ρ ak ∇fk T Gk .

    The purpose is simple: do not accept an iteration that moves too aggressively in a direction that fails to improve the fit sufficiently.

    The Real-Time Idea

    At first glance this may still look like a large calculation. There may be thousands of measured points.

    But notice something important.

    No matter how many data points we have, there are still only six unknown cone parameters.

    The Jacobian may have thousands of rows, but only six columns. The matrix

    JTJ

    is therefore only

    6×6.

    Similarly,

    JTE

    has only six components.

    So the data set can be large while the system that must be solved at each Gauss–Newton iteration remains very small.

    This is exactly the type of structure one wants to exploit in a real-time numerical algorithm.

    Did It Work?

    Yes.

    This was not an exercise invented to demonstrate Gauss–Newton. I developed the method because the cone-fitting calculation was needed in a real application, and it had to operate in real time.

    The implementation worked extremely well.

    That experience taught me an important lesson about applied mathematics: the best mathematical formulation is not necessarily the one that looks most sophisticated on paper.

    Sometimes the decisive question is:

    Can we formulate the problem so that the computer can solve it quickly enough to be useful?

    Why the Approximation Works

    There is another nice feature of Gauss–Newton.

    Recall that the exact Hessian is

    ∇2f = JTJ + ∑ j=1 m Rj ∇2 Rj .

    As the estimated cone approaches the data, the residuals become small. Consequently, the second term becomes less important and

    ∇2f ≈ JTJ .

    So as the algorithm approaches a good fit, the inexpensive approximation becomes increasingly appropriate.

    A Final Check

    Although computing the full Hessian at every iteration is expensive, it can still be useful after the optimization has finished.

    At the final solution we can evaluate

    ∇2f = JTJ + ∑ j=1 m Rj ∇2 Rj .

    If its eigenvalues are positive, the Hessian is positive definite and the computed stationary point is a local minimum.

    In other words, we use the inexpensive approximation while speed matters, and we can use the more expensive calculation afterward as a check.

    The Larger Lesson

    The mathematics of this problem can be summarized in one chain:

    3D measurements  →  cone geometry  →  residuals  →  least squares  →  Jacobian  →  Gauss–Newton  →  real-time fit.

    The cone itself is elementary geometry. Least squares is a classical idea. The derivatives require calculus. Gauss–Newton comes from numerical optimization.

    None of these ingredients alone solves the practical problem.

    The solution comes from putting them together in a form that a computer can evaluate rapidly.

    That is one of the most satisfying aspects of applied mathematics: sometimes a few familiar mathematical ideas, combined in the right way, turn a difficult real-world computation into something that works almost like magic.


    A Closely Related Fitting Problem

    Fitting a cone to a large cloud of measured points is one example of a broader problem: how can we recover a geometric surface accurately when the computation has to be fast enough for real-time use?

    A closely related problem replaces the cone by a cylinder. The geometry changes, but the same practical challenge remains: turn thousands of measurements into a reliable geometric fit without an expensive general-purpose optimization.

    Continue exploring: How Do You Fit a Cylinder to Thousands of Points in Real Time?

  • Why Does an OFDM Signal Have a Rayleigh Distribution?

    A complicated communication signal can sometimes be understood using surprisingly elementary mathematics.

    Consider a large number of vectors of length 1 pointing in random directions. Add them together. What can we say about the length of the resulting vector?

    This seemingly geometric probability problem leads directly to a standard mathematical model for OFDM (Orthogonal Frequency-Division Multiplexing), a technique used in modern digital communication.

    The path is beautiful:

    random phases → sine and cosine → Central Limit Theorem → two-dimensional Gaussian → Rayleigh distribution.

    Step 1: Add Random Unit Vectors

    Suppose that

    θ1 , θ2 , … , θN

    are independent random angles uniformly distributed between 0 and 2π .

    The corresponding unit complex numbers are

    e iθk = cos θk + i sin θk.

    Now add all of them:

    Z = ∑ k=1 N e iθk .

    Separating the real and imaginary parts gives

    Z = X + iY,

    where

    X = ∑ k=1 N cos θk , Y = ∑ k=1 N sin θk.

    Step 2: What Is the Distribution of One Coordinate?

    If θ is uniformly distributed on [0,2π] , then both sinθ and cosθ have density

    g (x) = 1 π 1−x2 , −1<x<1.

    This is sometimes called the arcsine distribution.

    By symmetry,

    E [cosθ] = E [sinθ] = 0.

    Also,

    E [ cosθ2 ] = E [ sinθ2 ] = 12.

    Therefore each coordinate has mean 0 and variance 12 .

    Step 3: The Central Limit Theorem Appears

    Now comes the key step.

    Both X and Y are sums of many independent random variables.

    When N is large, the Central Limit Theorem tells us that these sums are approximately normally distributed:

    X ≈ N ( 0 , N2 ) ,
    Y ≈ N ( 0 , N2 ) .

    In other words, the endpoint of our random walk is approximately described by a two-dimensional Gaussian distribution centered at the origin.

    Step 4: How Far Are We from the Origin?

    The amplitude of the complex sum is

    R = |Z| = X2 + Y2 .

    So we have reached a purely geometric question:

    If a point has two independent Gaussian coordinates, what is the distribution of its distance from the origin?

    The answer is the Rayleigh distribution.

    Since each coordinate has variance N2 , the approximate density of R is

    f (r) ≈ 2r N exp ( − r2 N ) , r≥0.

    This formula is important to interpret correctly. For a finite number of random unit vectors it is generally not the exact distribution. It is the large- N approximation produced by the Central Limit Theorem.

    A Shorter Derivation of the Rayleigh Formula

    There is also a beautiful geometric way to obtain the density.

    For large N, the joint density of (X,Y) is approximately

    p (x,y) = 1πN exp ( − x2 + y2 N ) .

    This density depends only on the distance from the origin.

    A thin circular ring of radius r and thickness dr has area approximately

    2πrdr.

    Multiplying the two-dimensional density by this ring area gives

    1πN exp ( − r2N ) · 2πrdr.

    Therefore,

    f (r) = 2rN exp ( − r2N ) .

    So the factor r in the Rayleigh distribution has a simple geometric origin: circles become longer as their radius increases.

    What Does This Have to Do with OFDM?

    An OFDM time-domain sample is produced by an inverse discrete Fourier transform. It therefore involves adding many complex contributions having different phases.

    This suggests viewing the sample, in a simplified model, as a sum of many complex vectors.

    That brings us back to exactly the random-vector problem above.

    An Example with 52 Active Carriers

    Consider a system with 64 available carrier positions, of which 52 are nonzero: 48 data carriers and 4 pilot carriers.

    The simple random-phasor model therefore suggests taking

    N=52.

    For a Rayleigh distribution with the density derived above, the expected amplitude is

    E[R] = πN 2 .

    For N=52 , this gives

    E[R] = 52π 2 ≈ 6.3907.

    How Good Is the Approximation?

    I originally investigated this question numerically by comparing the simple theoretical model with simulated OFDM signals.

    The theoretical mean amplitude for the 52-vector model is approximately 6.3907.

    A direct simulation of the random-vector model produced 6.3796.

    The corresponding simulated OFDM mean amplitudes were:

    Model Mean amplitude
    Rayleigh theory 6.3907
    Random-vector simulation 6.3796
    BPSK OFDM 6.3889
    QPSK OFDM 6.4015
    16QAM OFDM 6.4058
    64QAM OFDM 6.3837

    The agreement is remarkably good.

    A complicated digital communication signal has, at least at the level of its typical amplitude, been captured by a very simple model: add 52 vectors pointing in random directions.

    But What About Rare Peaks?

    Matching the average is not the whole story.

    For communication systems, unusually large signal peaks are important. An amplifier must be able to accommodate those peaks without severe distortion.

    This is where the difference between an approximation and an exact distribution becomes important.

    In the original numerical experiment, the simple theory tracked several OFDM simulations quite well at moderate thresholds. But differences appeared in the far tail of the distribution, particularly for BPSK.

    For example, at a peak-to-average threshold of 12 dB, the values from that simulation were approximately

    Model Tail probability
    Simple theory 4.0 × 10−6
    BPSK 1.969 × 10−3
    QPSK 9.4 × 10−5
    16QAM 7.9 × 10−5
    64QAM 4.0 × 10−5

    This illustrates an important lesson in probability.

    Two distributions can look very similar around their typical values while behaving quite differently in their extreme tails.

    The Central Limit Theorem explains the center of the distribution extremely well, but rare events can require more careful analysis.

    The Mathematics Behind a Communication Signal

    What I like about this example is the number of mathematical ideas that meet in one problem.

    We started with complex numbers:

    eiθ = cosθ + isinθ.

    Those became random vectors in the plane.

    Their coordinates led to probability distributions.

    Adding many of them brought in the Central Limit Theorem.

    The resulting two-dimensional Gaussian led, through elementary geometry, to the Rayleigh distribution:

    f (r) ≈ 2rN exp ( − r2N ) .

    And that simple formula gives a surprisingly accurate description of the amplitude of an OFDM signal.

    This is a good example of why mathematical modeling is so useful: the real system may be complicated, but sometimes the right simplified model exposes the mathematics underneath it.


    Where the Gaussian Function Enters the Story

    The Rayleigh distribution in OFDM is closely connected to Gaussian random variables. When many independent contributions combine, the in-phase and quadrature components of the signal are approximately Gaussian, and their magnitude produces the Rayleigh distribution.

    At the heart of the Gaussian distribution is the remarkable function e − x 2 . Its integral over the real line cannot be evaluated by finding an ordinary elementary antiderivative. Yet there is a beautiful way to compute it by moving from one dimension to two.

    Continue exploring: The Gaussian Integral and Beyond: From e^(-x²) to a Family of Integrals

  • A Sum of Cosines Is a Geometric Series—Could You Believe It?

    Consider the innocent-looking sum

    S = cosx + cos2x + cos3x + ⋯ + cosnx.

    At first glance, there is nothing geometric about it. The terms are cosines, not powers of a common ratio.

    But there is a geometric series hiding inside.

    The Key Idea

    Euler’s formula says

    eix = cosx + isinx.

    Therefore, the real part of eikx is coskx. Hence

    S = Re ( eix + e2ix + e3ix + ⋯ + enix ) .

    Now look carefully at the expression inside the parentheses. It is a geometric series!

    Its first term is eix, and its common ratio is also eix.

    Sum the Geometric Series

    Using the finite geometric-series formula,

    eix + e2ix + ⋯ + enix = eix 1 − enix 1 − eix .

    This already proves that our trigonometric sum comes from a geometric series. But we can simplify it further.

    A Useful Identity

    For any real number t,

    1 − eit = −2i eit/2 sin ( t2 ) .

    Apply this identity to both the numerator and denominator. After cancellation, we obtain

    eix + e2ix + ⋯ + enix = sin ( nx2 ) sin ( x2 ) e i (n+1)x 2 .

    Now take the real part. Since the real part of eiθ is cosθ, we arrive at

    cosx + cos2x + ⋯ + cosnx = sin ( nx2 ) cos ( (n+1)x 2 ) sin ( x2 ) .

    So the final formula is

    cosx + cos2x + ⋯ + cosnx = sin ( nx2 ) cos ( (n+1)x 2 ) sin ( x2 ) .

    This formula applies whenever sin(x/2)≠0. If x is a multiple of 2π, every cosine equals 1, so the original sum is simply n.

    There Is Geometry Behind the Geometric Series

    The connection is even more interesting than the algebra suggests.

    Each complex number

    eikx = coskx + isinkx

    can be viewed as a vector of length 1 making an angle kx with the positive horizontal axis.

    Thus the vectors

    eix , e2ix , e3ix , … , enix

    all have the same length, and each successive vector is obtained by rotating the previous one through exactly the same angle x.

    Place these vectors head-to-tail. They form a turning polygonal chain. Their vector sum is

    eix + e2ix + ⋯ + enix.

    And what is the horizontal component of this vector?

    Exactly

    cosx + cos2x + ⋯ + cosnx.

    So our sum of cosines really does have a geometric meaning.

    And the Sines Come for Free

    The imaginary part of exactly the same geometric series gives another classical identity:

    sinx + sin2x + ⋯ + sinnx = sin ( nx2 ) sin ( (n+1)x 2 ) sin ( x2 ) .

    One geometric series has given us two trigonometric identities.

    The Takeaway

    A sum such as

    cosx + cos2x + ⋯ + cosnx

    does not look remotely like a geometric series.

    But complex numbers reveal what is hidden:

    trigonometric sum → complex exponentials → geometric series → closed formula.

    Sometimes the hardest part of a problem is not doing the calculation. It is recognizing what the calculation really is.


    Another Unexpected Side of Trigonometry

    Writing a sum of cosines as part of a geometric series reveals algebra hidden inside trigonometry. There is another beautiful example of this idea in the historical problem of actually computing sines and cosines.

    Long before electronic calculators, Newton developed infinite series that turned sin ⁡ (x) and cos ⁡ (x) into expressions that could be evaluated using arithmetic.

    Continue exploring: How Newton Computed Sines and Cosines Without a Calculator

  • Can a Curve Fill a Square? The Mathematics of Space-Filling Curves

    Can a Curve Fill a Square?

    A curve is one-dimensional. A square is two-dimensional. So it seems impossible that a single continuous curve could pass through every point of a square.

    Surprisingly, it can.

    There exists a continuous function

    H : [0,1] → [0,1] × [0,1]

    whose image is the entire unit square. In other words, as the parameter moves continuously from 0 to 1, the point H(t) eventually reaches every point of the square.

    Such a curve is called a space-filling curve.

    The Hilbert Curve

    One of the most beautiful examples is the Hilbert curve. Instead of trying to draw the final curve immediately, we construct a sequence of increasingly complicated polygonal curves.

    Start with a square. Divide it into four equal smaller squares and connect their centers in an order that forms a U-shaped path.

    This is the first approximation.

    For the second approximation, divide each of the four squares into four smaller squares. We now have

    42 = 16

    small squares. Inside each group of four, place a suitably rotated or reflected copy of the previous pattern and connect the pieces.

    Repeat the process again and again.

    At stage n, the square has been divided into

    4n

    small squares, each having side length

    2 −n .

    The Squares Become Tiny

    The important feature of the construction is not merely that the number of squares increases. Their size simultaneously decreases to zero.

    A small square at stage n has side length

    12n,

    so its diameter is

    2 2n .

    Therefore,

    2 2n → 0 as n → ∞.

    The construction is examining the square on smaller and smaller scales.

    Why Does the Limit Fill the Square?

    Take any point P in the unit square.

    At the first stage, P belongs to at least one of the four small squares. Call one such square Q1.

    At the second stage, choose one of the smaller squares containing P and call it Q2. Continue in this way.

    We obtain nested squares

    Q1 ⊇ Q2 ⊇ Q3 ⊇ ⋯

    containing P, while

    diam ( Qn ) → 0.

    Since the squares shrink to a point, their intersection is precisely

    ⋂ n=1 ∞ Qn = {P}.

    The Hilbert construction assigns corresponding nested parameter intervals

    I1 ⊇ I2 ⊇ I3 ⊇ ⋯

    whose lengths also tend to zero. Their intersection therefore determines a parameter value t. For this value,

    H (t) = P.

    But P was an arbitrary point of the square. Thus the limiting curve reaches every point of the square.

    A Curve Whose Image Has Area 1

    This produces a remarkable conclusion.

    The domain of the Hilbert curve is the interval [0,1], but its image is

    H ( [0,1] ) = [0,1] × [0,1].

    Consequently, the image of this continuous curve has area

    1.

    This is very different from an ordinary smooth curve, whose area in the plane is zero.

    What Happens to the Length?

    The polygonal approximations also reveal something interesting.

    At stage n, the curve visits 4n small squares. The characteristic distance between neighboring points is of order

    2 −n .

    Therefore the total length is of order

    4n · 2 −n = 2n.

    As n→∞, this quantity tends to infinity.

    2n → ∞.

    Thus the approximations stay inside a square of area 1, but their lengths grow without bound.

    Does This Mean an Interval and a Square Are the Same?

    No.

    The Hilbert curve is continuous and onto, but it is not one-to-one. Different parameter values can correspond to the same point of the square.

    This distinction is essential. There is no continuous one-to-one correspondence with a continuous inverse between an interval and a square.

    The space-filling curve does something subtler: it continuously folds an interval over itself infinitely many times until its image covers the entire square.

    A Dimensional Clue

    There is another way to see why the numbers in the construction fit together so naturally.

    When lengths are reduced by a factor of 2, the number of pieces increases by a factor of 4:

    4 = 22.

    If we informally ask for a dimension d satisfying

    4 = 2d,

    then

    d = log4 log2 = 2.

    This scaling behavior gives a hint of how a construction beginning with a one-dimensional parameter can produce an image that occupies a two-dimensional region.

    Why Space-Filling Curves Are Useful

    Space-filling curves are not only mathematical curiosities. Hilbert-type orderings are useful whenever multidimensional data must be arranged in a one-dimensional sequence.

    The Hilbert ordering has an important locality property: points that are close along the curve tend to remain relatively close in space. This idea appears in spatial indexing, image processing, databases, and algorithms for organizing multidimensional data.

    A construction that originally seemed almost paradoxical therefore connects pure mathematics with practical computation.

    The Main Idea

    The Hilbert curve demonstrates how misleading our finite-dimensional intuition can be when a limiting process is repeated infinitely many times.

    Every finite approximation is just an ordinary polygonal curve. None of these approximations fills the square.

    But the subdivisions become arbitrarily small, and in the limit every point of the square is reached.

    A continuous image of a one-dimensional interval can therefore fill an entire two-dimensional square.


    Continue exploring: Another surprising example of how strange continuous functions can be: Can a Function Be Continuous Everywhere but Differentiable Nowhere?

    Not all interesting curves are as unusual as space-filling curves. Some are designed to create smooth, controllable shapes using only a few points. Discover how this works in Bézier Curves: How Four Points Create Beautiful Shapes .

  • A Surprising Improper Integral: Why the Integral of sin(ax)/x Is Always π/2

    A Surprising Improper Integral

    Consider the improper integral

    ∫ 0 ∞ sin ( ax ) x dx.

    At first glance, this integral looks difficult. The factor 1x suggests a singularity at the origin, while the sine function continues to oscillate forever as x→∞. There is no elementary antiderivative that immediately resolves the problem.

    Nevertheless, for every positive number a, the answer is remarkably simple:

    ∫ 0 ∞ sin ( ax ) x dx = π2.

    Even more surprisingly, the answer does not depend on the positive value of a. Let us see why.

    The Main Idea: Add a Damping Factor

    Instead of attacking the original integral directly, introduce a positive parameter t and define

    F ( t ) = ∫ 0 ∞ e −tx sin ( ax ) x dx , t>0.

    The factor e −tx suppresses the oscillations for large values of x. This makes the parameter-dependent integral easier to work with.

    The key step is to differentiate with respect to the parameter t. We obtain

    F′ ( t ) = − ∫ 0 ∞ e −tx sin ( ax ) dx.

    Notice what happened: the troublesome factor 1x has disappeared. We are left with a standard Laplace-type integral.

    Evaluating the Easier Integral

    For t>0, we have

    ∫ 0 ∞ e −tx sin ( ax ) dx = a t2 + a2 .

    Therefore,

    F′ ( t ) = − a t2 + a2 .

    Now the problem has been reduced to an elementary integral.

    Recovering F(t)

    As t→∞, the exponential damping becomes stronger and

    F ( t ) → 0.

    Thus, for a>0,

    F ( t ) = ∫ t ∞ a u2 + a2 du.

    Evaluating this integral gives

    F ( t ) = π2 − arctan ( ta ).

    Equivalently, using the elementary arctangent identity,

    F ( t ) = arctan ( at ).

    So we have actually obtained the more general and useful formula

    ∫ 0 ∞ e −tx sin ( ax ) x dx = arctan ( at ), a>0, t>0.

    Removing the Damping

    We introduced the exponential factor only to make the integral easier to evaluate. Now let t→0+ . Then

    arctan ( at ) → π2.

    and the damping factor approaches 1. This leads to the celebrated Dirichlet integral

    ∫ 0 ∞ sin ( ax ) x dx = π2, a>0.

    Why Does the Answer Not Depend on a?

    There is also a simple scaling argument that explains why the answer must be the same for every positive a. Set

    u=ax.

    Then

    x = ua, dx = du a .

    Therefore,

    ∫ 0 ∞ sin ( ax ) x dx = ∫ 0 ∞ sin ( u ) u du.

    The parameter a has completely disappeared. Changing a changes how rapidly the sine function oscillates, but the total value of the improper integral remains unchanged.

    What If a Is Zero or Negative?

    If a=0, the integrand is identically zero, so the integral is zero.

    If a<0, use the oddness of the sine function:

    sin ( ax ) = − sin ( −ax ).

    Hence the complete result is

    ∫ 0 ∞ sin ( ax ) x dx = π2 if a>0, 0 if a=0, −π2 if a<0.

    One Important Detail: The Integral Is Not Absolutely Convergent

    The convergence of this integral is subtle. Although

    ∫ 0 ∞ sin ( ax ) x dx

    converges for a≠0, the corresponding absolute-value integral

    ∫ 0 ∞ | sin ( ax ) | x dx

    diverges. Thus the positive and negative oscillations of the sine function are essential. They cancel one another just enough for the original improper integral to converge.

    A Useful Lesson

    The most interesting part of this calculation is not simply the final answer π2. It is the method.

    When an integral is difficult to evaluate directly, it can sometimes be embedded into a family of integrals depending on a parameter. Differentiating with respect to that parameter may transform the original problem into a much easier one. After solving the parameterized problem, we return to the original integral by taking a limit.

    In this example, the chain of ideas is

    sin ( ax ) x → e −tx sin ( ax ) x → F′ ( t ) → F ( t ) → π2.

    A difficult oscillatory improper integral has been reduced to an elementary rational integral. That is what makes the Dirichlet integral such a beautiful example of the power of introducing a parameter.


    Another Surprise from an Improper Integral

    The integral involving sin ⁡ ( a x ) x shows that an oscillating function extending over an infinite interval can nevertheless produce a beautifully simple finite value.

    There is another famous improper-integral paradox in which infinity appears in a completely different way: a surface extending forever can enclose a finite volume while having infinite surface area.

    Continue exploring: Gabriel’s Horn: When Can an Infinite Horn Be Painted?


    From the Dirichlet Integral to the Gaussian Integral

    There is another beautiful connection behind the Dirichlet integral. The Gaussian function e − x 2 leads to one of the most famous improper integrals in mathematics. Its evaluation introduces a remarkably powerful idea: turn a one-dimensional integral into a two-dimensional one and then use geometry.

    That same Gaussian structure appears in many unexpected places and provides another route into the world of remarkable improper integrals.

    Continue exploring: The Gaussian Integral and Beyond: From e^(-x²) to a Family of Integrals

  • Can a Circle Centered Outside Another Circle Cut Its Area Exactly in Half?

    Choose any point outside a circle. Can we draw a second circle, centered at that point, that covers exactly half the area of the original circle?

    Surprisingly, the answer is always yes. Even better, there is exactly one such circle.

    Let the original circle have center O and radius R. Choose a fixed point P outside the circle, and let

    d=OP>R.

    We want to find the radius r of a circle centered at P that covers exactly half of the original disk.

    Why must such a circle exist?

    Before calculating anything, we can prove that the desired circle must exist.

    Let A(r) denote the area of the part of the original disk covered by the circle centered at P with radius r.

    Since P is outside the original circle, the distance from P to the nearest point of the original circle is

    d−R.

    Therefore, when

    r=d−R,

    the two circles are externally tangent. They meet at only one point, so their common area is zero:

    A ( d−R ) =0.

    Now continue increasing r. Eventually,

    r=d+R.

    At this point the circle centered at P contains the entire original disk. Hence

    A ( d+R ) = πR2.

    As r increases, the circle centered at P grows continuously. Consequently, the area A(r) that it covers inside the original circle also changes continuously.

    It starts at

    0

    and eventually reaches

    πR2.

    Therefore, by the Intermediate Value Theorem, at some intermediate radius it must equal

    12 πR2.

    Thus there is at least one radius satisfying

    d−R <r< d+R

    for which the second circle covers exactly half of the original disk.

    Why is the radius unique?

    Suppose

    r1 < r2.

    The disk centered at P with the smaller radius is strictly contained in the disk with the larger radius. While the two circles intersect, increasing the radius captures an additional region of positive area inside the original disk.

    Therefore A(r) is strictly increasing for

    d−R <r< d+R.

    So the value

    A(r) = 12 πR2

    can occur only once. The required circle is therefore unique.

    Now let us calculate its radius

    Let the two circles intersect at points Q and S. Consider the triangle formed by O, P, and Q.

    Its side lengths are

    OQ=R,   PQ=r,   OP=d.

    Let α be the angle at O between OP and OQ, and let β be the angle at P between PO and PQ.

    By the Law of Cosines,

    cosα = d2 + R2 − r2 2dR .

    Hence

    α = arccos ( d2 + R2 − r2 2dR ).

    Applying the Law of Cosines at P gives

    cosβ = d2 + r2 − R2 2dr ,

    so

    β = arccos ( d2 + r2 − R2 2dr ).

    The area of the overlap

    The common lens consists of two circular segments.

    At O, the full central angle subtending the common chord is 2α. The area of the corresponding sector is

    R2α.

    The triangle inside this sector has area

    R2 sinα cosα.

    Thus the first circular segment has area

    R2 ( α − sinα cosα ).

    Similarly, the second circular segment has area

    r2 ( β − sinβ cosβ ).

    Therefore the total overlap area is

    A(r) = R2 ( α − sinα cosα ) + r2 ( β − sinβ cosβ ).

    The equation for the radius

    We want the overlap to be exactly half the area of the original circle. Therefore r must satisfy

    R2 ( α − sinα cosα ) + r2 ( β − sinβ cosβ ) = 12 πR2,

    where

    α = arccos ( d2 + R2 − r2 2dR )

    and

    β = arccos ( d2 + r2 − R2 2dr ).

    This is a transcendental equation, so in general the radius is found numerically. But our geometric argument has already established something important: for every d > R, this equation has exactly one solution in

    d−R <r< d+R.

    A scale-free version

    The problem really depends only on the ratio d/R. Define

    D=dR,   ρ=rR.

    Then D > 1, and the required value of ρ depends only on D. Once ρ is found, the actual radius is simply

    r=ρR.

    For example, if the outside point happens to satisfy

    d=2R,

    the numerical solution is

    r≈2.08225R.

    But this is only one example. The construction works for every point outside the original circle.

    The geometric conclusion

    We have proved the following result:

    Given any point outside a circle, there exists a unique circle centered at that point whose intersection with the original disk has exactly half the area of the original disk.

    The calculation of its radius requires solving a transcendental equation, but its existence does not. It follows from a simple geometric idea: start with a circle that barely touches the original circle and continuously increase its radius. The covered area grows continuously from zero to the entire area of the original disk, and therefore it must pass through exactly one-half.

    Some numerical examples

    Because the problem is unchanged by scaling, we may take

    R=1.

    For several choices of the distance d from the center of the original circle to the outside point, the table below gives the unique radius r that covers exactly half of the original disk.

    Distance d Required radius r
    1.10 1.24543
    1.25 1.37910
    1.50 1.60860
    2.00 2.08225
    2.50 2.56611
    3.00 3.05523
    5.00 5.03326

    For a circle of arbitrary radius R, these numbers should be interpreted as ratios. For example,

    dR =2

    gives

    rR ≈2.08225,

    or equivalently,

    r≈2.08225R.

    The table also reveals an interesting pattern: as the outside point moves farther from the original circle, the required radius becomes increasingly close to the distance d itself.


    Another Equal-Area Problem

    Dividing the area of a circle exactly in half with another circle raises a natural geometric question: can a circle do the same thing to a triangle?

    Continue exploring: Can a Circle Cut a Triangle in Half?

  • How Newton Computed Sines and Cosines Without a Calculator

    Today, if we want to know the sine or cosine of an angle, we simply press a button on a calculator. But suppose there is no calculator, no computer, and no trigonometric table.

    How could we actually compute, for example,

    sin ( 1 ° )

    using only arithmetic?

    One answer comes from the classical sine and cosine series associated with Isaac Newton. The series appeared in Newton’s De analysi per aequationes numero terminorum infinitas, written in 1665–1666. The elegant derivation below follows a later mean-value approach presented by Heinrich Dörrie, written here in modern calculus notation.

    The goal

    We want formulas that allow us to calculate the sine and cosine of an angle x. The angle must be measured in radians.

    The formulas we will obtain are

    sinx = x − x3 3! + x5 5! − x7 7! + ⋯

    and

    cosx = 1 − x2 2! + x4 4! − x6 6! + ⋯

    Today these are familiar power series. What is especially interesting is that we can derive them from a very simple idea: repeatedly taking averages.

    The key idea: average values

    Consider the average value of the sine function on the interval from 0 to x. In modern calculus notation,

    1 x ∫ 0 x sint dt = 1 − cosx x

    Similarly, the average value of cosine is

    1 x ∫ 0 x cost dt = sinx x

    These two elementary formulas are enough to generate increasingly accurate approximations for both sine and cosine.

    Start with the simplest inequality

    For a positive angle x sufficiently close to zero,

    cosx < 1

    Now take the average of both sides from 0 to x. The average of the left side is

    sinx x

    while the average of 1 is simply 1. Therefore,

    sinx x < 1

    and hence

    sinx < x

    We have obtained our first approximation:

    sinx ≈ x

    Average again

    Now start with

    sinx < x

    and take averages once more. The average of the left side is

    1 − cosx x

    while the average of the function t on the interval from 0 to x is x/2. Thus,

    1 − cosx x < x 2

    Multiplying by x and rearranging gives

    cosx > 1 − x2 2!

    And again

    Take averages of this new inequality. The average of cosine is

    sinx x

    and the average of the right-hand side is

    1 − x2 6

    Therefore,

    sinx x > 1 − x2 6

    and consequently

    sinx > x − x3 3!

    We have now trapped sine between two simple expressions:

    x − x3 3! < sinx < x

    Keep repeating the process

    Each time we take another average, we obtain another term. Continuing gives alternating upper and lower bounds:

    sinx < x − x3 3! + x5 5!

    and then

    sinx > x − x3 3! + x5 5! − x7 7!

    The upper and lower approximations become closer and closer. Their common limiting value gives

    sinx = x − x3 3! + x5 5! − x7 7! + ⋯

    The same procedure gives

    cosx = 1 − x2 2! + x4 4! − x6 6! + ⋯

    A built-in error estimate

    There is another important advantage. If we stop either series after a finite number of terms, the error is smaller in absolute value than the first term we leave out.

    For example, if we use

    sinx ≈ x − x3 3!

    then the error is smaller than

    x5 5!

    This means that the series does not merely give us an approximation. It also tells us how accurate that approximation is.

    Computing sin(1°)

    Now let us actually calculate a trigonometric value without using a table.

    One degree in radians is

    x = π 180 ≈ 0.01745329252

    Since this number is very small, just two terms of the sine series already give extraordinary accuracy:

    sin ( 1 ° ) ≈ x − x3 6

    Substituting the value of x gives

    sin ( 1 ° ) ≈ 0.0174524064

    How accurate is this?

    The first omitted term is

    x5 120 < 0.00000000002

    Thus only two terms are enough to determine sin(1°) correctly to ten decimal places:

    sin ( 1 ° ) ≈ 0.0174524064

    That is a remarkable amount of accuracy from such a short calculation.

    Computing the cosine

    The cosine works in exactly the same way. For one degree,

    cosx ≈ 1 − x2 2 + x4 24

    which gives

    cos ( 1 ° ) ≈ 0.9998476952

    Again, only a few arithmetic operations are needed.

    Why radians matter

    There is one essential detail: these formulas require angles to be measured in radians.

    The fundamental approximation

    sinx ≈ x

    works in this form because radian measure connects an angle directly with arc length on the unit circle.

    If an angle is given in degrees, convert it first:

    x = ( angle in degrees ) π 180

    The larger idea

    What makes this argument beautiful is not merely the final formulas. It is how little we need in order to discover them.

    We begin with the elementary inequality

    cosx < 1

    and repeatedly take average values. Each step produces another power of x, another factorial in the denominator, and a sharper approximation.

    Eventually the familiar patterns emerge:

    sinx = x − x3 3! + x5 5! − ⋯ cosx = 1 − x2 2! + x4 4! − ⋯

    A calculator evaluates sine and cosine instantly. These series reveal some of the mathematics behind that computation: trigonometric values can be constructed, digit by digit, using powers, factorials, addition, subtraction, multiplication, and division.

    Reference

    The mean-value derivation in this article is adapted, using modern calculus notation, from Heinrich Dörrie, 100 Great Problems of Elementary Mathematics: Their History and Solution, translated by David Antin, Dover Publications, Problem 15, “Newton’s Sine and Cosine Series,” pp. 59–63.


    Another Unexpected Side of Trigonometry

    Newton’s approach shows that familiar trigonometric functions can be reconstructed from infinite algebraic expansions. But there is another surprising algebraic connection hiding in trigonometry.

    Consider the finite sum cos ⁡ (x) + cos ⁡ (2x) + ⋯ + cos ⁡ (nx). At first glance, it has nothing to do with a geometric series. Yet a simple change of viewpoint reveals exactly that structure.

    Continue exploring: A Sum of Cosines Is a Geometric Series—Could You Believe It?

  • Proving 1 + 1/4 + 1/9 + ⋯ = π²/6 with a Double Integral

    One of the most famous identities in mathematics is

    1 + 14 + 19 + 116 + ⋯ = π2 6 .

    In summation notation,

    ∑ n=1 ∞ 1 n2 = π2 6 .

    This is known as the Basel problem. Euler famously solved it in the eighteenth century. There are many proofs, but one particularly beautiful approach uses a double integral and an unexpected change of variables.

    Start with the odd terms

    Instead of attacking the entire series immediately, consider only the reciprocals of the odd squares:

    S = 1 + 132 + 152 + 172 + ⋯ .

    We will first prove that

    S = π2 8 .

    The full Basel sum will then follow almost immediately.

    Turn the series into a double integral

    Consider

    I = ∫01 ∫01 1 1 − x2 y2 dx dy .

    For points inside the unit square, the geometric-series identity gives

    1 1 − x2 y2 = ∑ n=0 ∞ xy 2n .

    Therefore,

    I = ∑ n=0 ∞ ( ∫01 x2n dx ) ( ∫01 y2n dy ) .

    Each one-dimensional integral is

    ∫01 x2n dx = 1 2n+1 .

    Hence

    I = ∑ n=0 ∞ 1 (2n+1) 2 .

    Thus the double integral is exactly the sum of the reciprocals of the odd squares:

    I = 1 + 132 + 152 + ⋯ .

    The key change of variables

    Now comes the surprising part. Introduce new variables u and v by

    x = sin(u) cos(v) , y = sin(v) cos(u) .

    The square

    0≤x≤1 , 0≤y≤1

    corresponds to the triangular region

    u≥0 , v≥0 , u+v ≤ π2 .

    To see where the last boundary comes from, notice that

    x≤1 ⇔ sin(u) ≤ cos(v) ⇔ u+v ≤ π2 ,

    and the condition on y gives the same inequality.

    The Jacobian

    We compute

    ∂x∂u = cos(u) cos(v) , ∂x∂v = sin(u) sin(v) cos(v) 2 .

    Similarly,

    ∂y∂u = sin(u) sin(v) cos(u) 2 , ∂y∂v = cos(v) cos(u) .

    After simplifying the determinant, the Jacobian is

    ∂(x,y) ∂(u,v) = 1 − x2 y2 .

    This is exactly the expression that appears in the denominator of our original integral. Therefore,

    dxdy 1 − x2 y2 = dudv .

    The complicated-looking integrand has completely disappeared.

    The integral becomes an area

    Our double integral is now simply

    I = ∫ 0 π2 ∫ 0 π2 − u dv du .

    Geometrically, this is the area of a right triangle whose two perpendicular sides both have length

    π2

    Therefore,

    I = 12 · π2 · π2 = π2 8 .

    We have proved that

    1 + 132 + 152 + 172 + ⋯ = π2 8 .

    Recovering the full series

    Let

    T = ∑ n=1 ∞ 1 n2 .

    Split the series into its odd and even terms. The odd terms have sum

    π2 8

    while the even terms have sum

    122 + 142 + 162 + ⋯ = 14 T .

    Consequently,

    T = π2 8 + 14 T .

    Thus,

    34 T = π2 8 ,

    and finally,

    T = π2 6 .

    Why this proof is remarkable

    We started with an infinite series involving nothing but reciprocals of squares. We then represented part of that series by a double integral over a square. A carefully chosen trigonometric change of variables transformed the square into a triangle and, at the same time, made the integrand disappear.

    The infinite series was therefore reduced to the area of a triangle:

    12 · π2 · π2 = π2 8 .

    From there, separating the odd and even terms gives the celebrated result

    ∑ n=1 1 n2 = π2 6 .

    It is a striking example of how an infinite series, a double integral, a trigonometric substitution, and a simple geometric area can all describe the same number.


    Another Problem Where Two Dimensions Help

    The double-integral proof of the Basel sum illustrates a powerful mathematical idea: sometimes a problem becomes easier when we move to a higher dimension.

    One of the most beautiful examples is the Gaussian integral. A one-dimensional integral that resists ordinary antiderivative methods becomes accessible after it is squared and transformed into a two-dimensional integral.

    Continue exploring: The Gaussian Integral and Beyond: From e^(-x²) to a Family of Integrals

    Long before Euler solved the Basel problem, ancient Greek mathematicians had developed ingenious geometric methods for evaluating infinite sums. In particular, Archimedes used areas of triangles to establish a remarkable infinite series identity. Discover his method in How the Ancient Greeks Summed Infinite Series Without Calculus .