{
  "cells": [
    {
      "cell_type": "markdown",
      "id": "markdown-000",
      "metadata": {},
      "source": [
        "# Computational arrow of time\n",
        "\n",
        "[Read the lesson](https://tirta.co/a-byte-of-physics/computational-arrow-of-time). This notebook includes the lesson text and its Python examples in reading order. Run the setup cell, then run the remaining cells from top to bottom. In Colab, use File → Save a copy in Drive to keep your edits. You can run and edit this view without changing the course source. Examples use illustrative data unless stated otherwise."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-001",
      "metadata": {},
      "source": [
        "import importlib.metadata\n",
        "import subprocess\n",
        "import sys\n",
        "\n",
        "requirements = {\"numpy\": (2, 0), \"sympy\": (1, 13), \"matplotlib\": (3, 8)}\n",
        "to_install = []\n",
        "for package, minimum in requirements.items():\n",
        "    try:\n",
        "        installed = importlib.metadata.version(package)\n",
        "        version = tuple(int(part) for part in installed.split(\".\")[:2])\n",
        "    except importlib.metadata.PackageNotFoundError:\n",
        "        version = (0, 0)\n",
        "    if version < minimum:\n",
        "        to_install.append(f\"{package}>={minimum[0]}.{minimum[1]}\")\n",
        "if to_install:\n",
        "    subprocess.check_call([sys.executable, \"-m\", \"pip\", \"install\", *to_install])\n",
        "\n",
        "import numpy as np\n",
        "import sympy as sp\n",
        "import matplotlib\n",
        "import matplotlib.pyplot as plt\n",
        "\n",
        "print(\"Python\", sys.version.split()[0])\n",
        "print(\"NumPy\", np.__version__)\n",
        "print(\"SymPy\", sp.__version__)\n",
        "print(\"Matplotlib\", matplotlib.__version__)\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-002",
      "metadata": {},
      "source": [
        "A computer program naturally has an execution order: read a state, calculate a later\n",
        "state, and overwrite or store the result. That order is a computational arrow of time,\n",
        "but it is not automatically the thermodynamic arrow of the modeled system. Forward-only\n",
        "code can represent reversible physics, and reversible-looking code can hide physical\n",
        "dissipation in an omitted environment.\n",
        "\n",
        "The useful question is not merely whether a program can run backward. It is which\n",
        "information the physical law, numerical update, and data pipeline each preserve or\n",
        "discard.\n",
        "\n",
        "## An update index is not a physical arrow\n",
        "\n",
        "A discrete calculation often has the form\n",
        "\n",
        "\n",
        "$$\n",
        "x_{n+1}=F_{\\Delta t}(x_n)\n",
        "$$\n",
        "\n",
        "\n",
        "Here $x_n$ is the complete stored state,\n",
        "$\\Delta t$ is the modeled time interval, and\n",
        "$F_{\\Delta t}$ is the numerical\n",
        "update.\n",
        "\n",
        "The increasing index $n$ records execution\n",
        "order. It does not prove entropy production. A program for ideal projectile motion also\n",
        "increments an index even though the underlying conservative mechanics is time-reversal\n",
        "symmetric.\n",
        "\n",
        "To discuss reversibility, ask whether an inverse map exists and whether it corresponds to\n",
        "the physical reversal. If\n",
        "\n",
        "\n",
        "$$\n",
        "F_{\\Delta t}^{-1}(F_{\\Delta t}(x))=x\n",
        "$$\n",
        "\n",
        "\n",
        "then the stored update is mathematically invertible over its state space. Time symmetry\n",
        "usually asks for the stronger physically matched relation\n",
        "\n",
        "\n",
        "$$\n",
        "F_{-\\Delta t}=F_{\\Delta t}^{-1}\n",
        "$$\n",
        "\n",
        "\n",
        "An update can be invertible without satisfying this relation.\n",
        "\n",
        "## Forward Euler shows the difference\n",
        "\n",
        "For a harmonic oscillator with angular frequency\n",
        "$\\omega$, forward Euler\n",
        "updates position and velocity as\n",
        "\n",
        "\n",
        "$$\n",
        "x_{n+1}=x_n+v_n\\Delta t,\n",
        "  \\qquad\n",
        "  v_{n+1}=v_n-\\omega^2x_n\\Delta t\n",
        "$$\n",
        "\n",
        "\n",
        "The update matrix has determinant\n",
        "\n",
        "\n",
        "$$\n",
        "\\det F_{\\Delta t}=1+\\omega^2\\Delta t^2\n",
        "$$\n",
        "\n",
        "\n",
        "The determinant is nonzero, so the exact algebraic matrix is invertible. However, replacing\n",
        "the time step by its negative does not give the inverse. Applying one positive step and\n",
        "then one negative step enlarges the state rather than restoring it. The method also\n",
        "produces systematic energy growth for this oscillator.\n",
        "\n",
        "This example separates three ideas: invertibility, time symmetry, and physical accuracy.\n",
        "They are not synonyms. A symplectic, time-symmetric method such as velocity Verlet is\n",
        "usually a better reversible-mechanics reference, although finite-precision arithmetic can\n",
        "still prevent bit-for-bit recovery.\n",
        "\n",
        "## Many-to-one operations create information loss\n",
        "\n",
        "A map is not invertible when different input states produce the same output. Rounding two\n",
        "nearby coordinates to the same stored number is many-to-one. A histogram discards\n",
        "particle identities and exact positions. Saving every hundredth step discards the\n",
        "intermediate trajectory. Rendering state as pixels discards far more than it displays.\n",
        "\n",
        "These operations may be sensible, but their outputs answer narrower questions. A video\n",
        "can show qualitative motion; it cannot replace the full state needed to verify energy\n",
        "conservation or reverse a trajectory.\n",
        "\n",
        "Loss occurs in layers:"
      ]
    },
    {
      "cell_type": "code",
      "id": "code-003",
      "metadata": {},
      "source": [
        "import numpy as np\n",
        "\n",
        "states = np.array([0.12341, 0.12344])\n",
        "rounded = np.round(states, 3)\n",
        "assert states[0] != states[1] and rounded[0] == rounded[1]\n",
        "print(\"Distinct states map to the same displayed value:\", rounded)\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-004",
      "metadata": {},
      "source": [
        "Every arrow should have a documented rule. If the raw layer is deleted, the reduced layer\n",
        "cannot later recreate distinctions it never retained.\n",
        "\n",
        "## Diffusion is easy forward and unstable backward\n",
        "\n",
        "Macroscopic diffusion provides a strong example of a directional computation. A Fourier\n",
        "mode with wave number $k$ under the\n",
        "diffusion equation decays as\n",
        "\n",
        "\n",
        "$$\n",
        "A_k(t)=A_k(0)e^{-Dk^2t}\n",
        "$$\n",
        "\n",
        "\n",
        "Here $A_k$ is the mode\n",
        "amplitude and $D$ is positive.\n",
        "Fine-scale modes have large wave numbers and decay fastest, so the field becomes smooth.\n",
        "\n",
        "Formally reconstructing the initial mode requires\n",
        "\n",
        "\n",
        "$$\n",
        "A_k(0)=A_k(t)e^{Dk^2t}\n",
        "$$\n",
        "\n",
        "\n",
        "The reverse factor amplifies tiny measurement and roundoff errors most strongly at high\n",
        "wave number. The backward heat problem is therefore ill-conditioned: a mathematical\n",
        "expression exists, but finite data cannot recover the lost fine structure reliably.\n",
        "\n",
        "This macroscopic equation already assumes coarse-grained local variables. Its practical\n",
        "irreversibility should not be confused with a claim that every underlying molecular\n",
        "collision violates time-reversal symmetry.\n",
        "\n",
        "## Chaos changes reproducibility requirements\n",
        "\n",
        "In a chaotic model, tiny differences in initial state, floating-point order, or time step\n",
        "can grow until two microscopic trajectories disagree. Bitwise reproducibility is useful\n",
        "for auditing one implementation, but it is not the only scientific target.\n",
        "\n",
        "Three levels should be distinguished:\n",
        "\n",
        "- Bitwise replay asks whether the same computational environment produces identical\n",
        "  stored values.\n",
        "- Numerical convergence asks whether reducing the step and error tolerances makes chosen\n",
        "  observables approach stable values.\n",
        "- Statistical reproducibility asks whether distributions and macroscopic estimates agree\n",
        "  across independent preparations within uncertainty.\n",
        "\n",
        "A parallel sum may change floating-point addition order and alter the last few bits.\n",
        "Chaotic dynamics can amplify that difference. The later trajectory mismatch is not\n",
        "automatically a new physical effect. Compare conserved quantities, distributions, and\n",
        "declared observables as well as exact state hashes.\n",
        "\n",
        "## Randomness has hidden state\n",
        "\n",
        "A pseudorandom generator is a deterministic state machine. A seed selects its initial\n",
        "state, but reproducibility also depends on the generator algorithm and the order in which\n",
        "random values are consumed. Adding one draw in an unrelated code path can shift every\n",
        "later result.\n",
        "\n",
        "For checkpoint replay, save the complete generator state at the checkpoint, not only the\n",
        "original seed. External randomness from hardware, operating-system entropy, network\n",
        "events, or user input must be recorded if exact replay is required.\n",
        "\n",
        "Replaying a random stream reproduces a sampled path. It does not make that path\n",
        "statistically independent evidence, and it does not invert a many-to-one stochastic\n",
        "transition.\n",
        "\n",
        "## Checkpoints localize divergence\n",
        "\n",
        "Saving every state may be too expensive, while saving only the final image makes a\n",
        "failure difficult to diagnose. Checkpoints create a middle path. Each checkpoint can\n",
        "include a state hash, physical diagnostics, numerical settings, and random-generator\n",
        "state."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-005",
      "metadata": {},
      "source": [
        "import hashlib\n",
        "\n",
        "\n",
        "def checkpoints(seed):\n",
        "    rng = np.random.default_rng(seed)\n",
        "    x, saved = 0.0, []\n",
        "    for step in range(100):\n",
        "        x += rng.normal()\n",
        "        if step % 10 == 0:\n",
        "            digest = hashlib.sha256(np.float64(x).tobytes()).hexdigest()\n",
        "            saved.append((step, x, digest))\n",
        "    return saved\n",
        "\n",
        "\n",
        "assert checkpoints(42) == checkpoints(42)\n",
        "print(\"Replay matched all checkpoints in this environment.\")\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-006",
      "metadata": {},
      "source": [
        "Hashes detect any byte-level difference but do not measure physical importance.\n",
        "Diagnostic tolerances must use units and scales. A tiny position difference and a large\n",
        "energy violation should not be collapsed into one unexplained boolean.\n",
        "\n",
        "## Storage policy creates an observational arrow\n",
        "\n",
        "Overwriting the previous state is often sufficient to advance a calculation, but it makes\n",
        "the trajectory unrecoverable. Append-only event logs preserve history but can become\n",
        "large. Checkpointing plus deterministic replay trades storage for computation.\n",
        "\n",
        "Compression can be lossless or lossy. A lossless codec restores the exact stored bytes; a\n",
        "lossy codec cannot. Even lossless storage of sampled checkpoints omits unsaved times.\n",
        "Descriptions should name both compression type and sampling cadence.\n",
        "\n",
        "Derived data should be reproducible from a versioned recipe. Store plot axes, bin edges,\n",
        "filter settings, normalization rules, and source checkpoint identifiers. Inferring\n",
        "measurements back from pixels creates avoidable uncertainty.\n",
        "\n",
        "## Computational loss is not thermodynamic entropy\n",
        "\n",
        "Deleting a file or rounding a coordinate reduces the information available to the\n",
        "analyst, but it is not by itself a calculation of thermodynamic entropy production.\n",
        "Thermodynamics requires a physical system boundary, reservoirs, temperatures, energy\n",
        "transfers, and an ensemble interpretation.\n",
        "\n",
        "Likewise, deterministic replay does not validate the physical model. A perfectly\n",
        "reproducible program can implement the wrong force law. Reproducibility makes errors\n",
        "traceable; independent physical checks establish accuracy.\n",
        "\n",
        "For a thermodynamic claim, use the total entropy balance\n",
        "\n",
        "\n",
        "$$\n",
        "\\Delta S_{\\mathrm{total}}\n",
        "  =\\Delta S_{\\mathrm{system}}\n",
        "  +\\Delta S_{\\mathrm{surroundings}}\n",
        "$$\n",
        "\n",
        "\n",
        "Then identify which physical interaction changes each term. Do not substitute storage\n",
        "bytes, state hashes, or visual complexity for entropy in joules per kelvin.\n",
        "\n",
        "## Evidence for an accountable computation\n",
        "\n",
        "Begin with a small case having an analytic solution or conserved quantity. Confirm that\n",
        "the implementation approaches that result as the step is reduced. For reversible\n",
        "mechanics, test the reversal operation over one step before a long trajectory. Introduce\n",
        "rounding or downsampling only after the lossless reference works.\n",
        "\n",
        "Record the first checkpoint where a replay differs. Determine whether the cause is an\n",
        "input change, generator-state mismatch, update-order change, dependency change, or\n",
        "platform-dependent arithmetic. Then ask whether the discrepancy changes the physical\n",
        "observable beyond its numerical and statistical tolerance.\n",
        "\n",
        "The computational arrow is ultimately an audit of transformations. Forward state\n",
        "updates, lossy observation, finite precision, chaotic amplification, and thermodynamic\n",
        "irreversibility may all point in the same practical direction, but they are different\n",
        "mechanisms. Keeping their evidence separate makes both the code and the physics easier to\n",
        "trust.\n",
        "\n",
        "## A worked Python notebook\n",
        "\n",
        "Compare a display spacing of 0.001 with the magnitude of a stored positive state. The question for this calculation is precise: how does **display quantisation scale relative to value**\n",
        "change when we change **unrounded state value**, while keeping the other choices fixed?\n",
        "The earlier sections explain the physical relationship. Here we turn one part of that\n",
        "relationship into a calculation that you can run, inspect, and change in Google Colab.\n",
        "\n",
        "This ratio describes representation; it does not supply a physical law for entropy production. Keep that sentence beside the results. A formula can return a number outside\n",
        "its useful range, and a plotting library will usually draw that number without asking\n",
        "whether the physical assumptions still hold. The selected interval is from\n",
        "0.01 to 1 dimensionless. It gives us a specific domain to discuss\n",
        "instead of leaving the graph's range to a software default.\n",
        "\n",
        "Use the notebook link above the lesson, run the setup cell, and then run the cells in\n",
        "order. The code below is also included there. NumPy handles the arrays of numerical\n",
        "values, SymPy keeps the equation symbolic, and Matplotlib draws the results. If these\n",
        "libraries or notebook cells are unfamiliar, start with\n",
        "[Your first physics notebook](https://tirta.co/a-byte-of-physics/your-first-physics-notebook).\n",
        "\n",
        "### State the relationship before choosing a graph\n",
        "\n",
        "In this small example, `q` stands for unrounded state value, expressed in dimensionless. The output is\n",
        "display quantisation scale relative to value, expressed in dimensionless. The equation below uses the numerical values in those\n",
        "units. Any fixed coefficients therefore carry the units needed to make the relation\n",
        "consistent. A value supplied in another unit must be converted before it enters this\n",
        "expression.\n",
        "\n",
        "\n",
        "$$\n",
        "f(q) = \\frac{0.001}{q}\n",
        "$$\n",
        "\n",
        "\n",
        "This is a function of one changing input. It is not a statement that the physical\n",
        "system has only one variable. We deliberately hold the other inputs fixed so that one\n",
        "cause of variation is visible. Changing several inputs at once would make it harder\n",
        "to tell which change produced the output difference. Write down the held-fixed choices\n",
        "before trying a different experiment.\n",
        "\n",
        "At 0.1 dimensionless, the expression gives 0.01 dimensionless. This is our\n",
        "reference calculation. It is a prediction of the stated example, not a new measurement.\n",
        "Its displayed digits help us compare implementations. They should not be read as a\n",
        "claim that physical inputs are known to six significant figures."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-007",
      "metadata": {},
      "source": [
        "import numpy as np\n",
        "import sympy as sp\n",
        "import matplotlib.pyplot as plt\n",
        "\n",
        "q = sp.Symbol(\"q\", real=True)\n",
        "expression = sp.sympify(\"0.001/q\", locals={\"q\": q})\n",
        "reference_input = 0.1\n",
        "reference_output = float(expression.subs(q, reference_input))\n",
        "print(\"Input:\", reference_input, \"dimensionless\")\n",
        "print(\n",
        "    \"Predicted display quantisation scale relative to value:\",\n",
        "    reference_output,\n",
        "    \"dimensionless\",\n",
        ")\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-008",
      "metadata": {},
      "source": [
        "`sp.Symbol` declares a mathematical symbol. It does not assign a numerical measurement\n",
        "to that symbol. `subs` then replaces the symbol with our chosen input, and `float`\n",
        "converts the resulting symbolic number into a standard Python numerical value.\n",
        "Keeping these steps separate lets us inspect the equation before numerical substitution.\n",
        "It also prevents a later plot from becoming the only surviving record of the model.\n",
        "\n",
        "### Compare a few cases you can explain\n",
        "\n",
        "Before drawing hundreds of points, calculate three. The lower endpoint gives\n",
        "0.1 dimensionless. The midpoint, at 0.505 dimensionless, gives\n",
        "0.0019802 dimensionless. The upper endpoint gives 0.001 dimensionless.\n",
        "Read these together with the assumptions: they describe different choices of unrounded state value\n",
        "within the same example, with the other inputs held fixed.\n",
        "\n",
        "These three values are a useful first check, but they do not establish the shape between\n",
        "them. Two endpoints can be equal even when the curve bends or oscillates in between.\n",
        "Likewise, a large change between endpoints does not tell us whether the relationship is\n",
        "linear. We need the equation and intermediate samples to answer those questions."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-009",
      "metadata": {},
      "source": [
        "evaluate = sp.lambdify(q, expression, modules=\"numpy\")\n",
        "inputs = np.array([0.01, 0.505, 1.0])\n",
        "outputs = np.asarray(evaluate(inputs), dtype=float)\n",
        "outputs = np.broadcast_to(outputs, inputs.shape)\n",
        "for input_value, output_value in zip(inputs, outputs):\n",
        "    print(f\"{input_value:.6g} dimensionless -> {output_value:.6g} dimensionless\")\n",
        "assert np.all(np.isfinite(outputs))\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-010",
      "metadata": {},
      "source": [
        "`lambdify` turns the symbolic expression into a numerical function. We explicitly select\n",
        "NumPy as its numerical backend so it can accept an array. The same expression now has\n",
        "two useful forms: one for algebra and one for calculating many cases. The assertion\n",
        "checks that the chosen inputs produce finite outputs. It would catch an infinity or an\n",
        "undefined numerical result, but a finite value can still be physically inappropriate.\n",
        "\n",
        "### Make a graph that answers the question\n",
        "\n",
        "The horizontal axis shows unrounded state value; the vertical axis shows display quantisation scale relative to value. Every plotted\n",
        "point is a prediction of the same expression. We mark the reference case separately\n",
        "so that a reader can connect the earlier printed value to its place on the curve.\n",
        "The axis labels include units because a shape without a scale cannot tell us the size\n",
        "of a physical effect."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-011",
      "metadata": {},
      "source": [
        "input_grid = np.linspace(0.01, 1.0, 301)\n",
        "output_grid = np.asarray(evaluate(input_grid), dtype=float)\n",
        "output_grid = np.broadcast_to(output_grid, input_grid.shape)\n",
        "fig, ax = plt.subplots(figsize=(7, 4))\n",
        "ax.plot(input_grid, output_grid, label=\"Stated model\")\n",
        "ax.scatter([reference_input], [reference_output], label=\"Reference case\", zorder=3)\n",
        "ax.set_xlabel(\"Unrounded state value (dimensionless)\")\n",
        "ax.set_ylabel(\"Display quantisation scale relative to value (dimensionless)\")\n",
        "ax.legend()\n",
        "ax.grid(alpha=0.25)\n",
        "fig.tight_layout()\n",
        "plt.show()\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-012",
      "metadata": {},
      "source": [
        "Look for a sign change, a turning point, or a region where the curve becomes steep.\n",
        "Connect each feature to the expression rather than to the colour of the line. If the\n",
        "curve has a minimum or maximum, changing the input in opposite directions may have\n",
        "similar effects on the output near that point. If it is nearly straight over a short\n",
        "interval, a local linear approximation may be useful even when the complete expression\n",
        "is nonlinear.\n",
        "\n",
        "Increasing the number of samples makes the line smoother and may reveal features that\n",
        "a coarse grid missed. It does not improve the physical inputs or enlarge the model's\n",
        "validity range. For quantities that can take only discrete values, use the line as a\n",
        "guide to the relationship and interpret only the allowed input values. A plotting\n",
        "function does not enforce such restrictions for you.\n",
        "\n",
        "### Measure the local sensitivity\n",
        "\n",
        "A derivative asks a more specific question than the whole graph: how quickly does\n",
        "display quantisation scale relative to value change near the reference input? Its units are the output unit divided by\n",
        "the input unit. For this calculation, the derivative at 0.1 dimensionless is\n",
        "-0.1 in those ratio units. Locally, the output decreases as the\n",
        "input increases. This statement is local; the sign or size of the slope can be different\n",
        "elsewhere on the curve.\n",
        "\n",
        "\n",
        "$$\n",
        "f'(q) = - \\frac{0.001}{q^{2}}\n",
        "$$\n",
        "\n",
        "\n",
        "For a small input change, multiply the derivative by that change to estimate the output\n",
        "change. Then compare that estimate with a fresh evaluation of the full expression.\n",
        "The distinction between these two calculations matters: the derivative gives a tangent\n",
        "approximation, while substitution evaluates the chosen expression at the new point."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-013",
      "metadata": {},
      "source": [
        "slope_expression = sp.diff(expression, q)\n",
        "slope_at_reference = float(slope_expression.subs(q, reference_input))\n",
        "changed_input = 0.10495\n",
        "linear_prediction = reference_output + slope_at_reference * (\n",
        "    changed_input - reference_input\n",
        ")\n",
        "full_prediction = float(evaluate(changed_input))\n",
        "print(\"Symbolic derivative:\", slope_expression)\n",
        "print(\"Tangent prediction:\", linear_prediction, \"dimensionless\")\n",
        "print(\"Full expression:\", full_prediction, \"dimensionless\")\n",
        "print(\"Approximation difference:\", full_prediction - linear_prediction, \"dimensionless\")\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-014",
      "metadata": {},
      "source": [
        "Here the changed input is 0.10495 dimensionless. The tangent estimate is\n",
        "0.009505 dimensionless, while the full expression gives\n",
        "0.00952835 dimensionless. If the two values are close, it means the chosen\n",
        "input change is small enough for this local approximation at this point. It does not\n",
        "mean the entire model is linear. If the slope is zero, a quadratic or higher-order term\n",
        "may supply the leading change instead.\n",
        "\n",
        "This is also the beginning of uncertainty propagation. If the input has a small stated\n",
        "standard uncertainty, the magnitude of the slope times that uncertainty estimates one\n",
        "contribution to output uncertainty. Do not automatically use the same rule for a wide\n",
        "interval, a discontinuity, a turning point with zero first derivative, or several\n",
        "correlated uncertain inputs. Those situations need more of the model than one slope.\n",
        "\n",
        "### Check the derivative with numerical differences\n",
        "\n",
        "We can estimate the same slope from values on either side of the reference point.\n",
        "Subtract the lower output from the upper output and divide by twice the input step.\n",
        "Parentheses are essential: the entire output difference must be divided by the entire\n",
        "input interval. Without them, Python can execute a different mathematical expression\n",
        "while still producing a plausible number.\n",
        "\n",
        "The calculation below uses three decreasing step sizes. Each estimate is compared with\n",
        "the symbolic derivative, so the reference is independent of the numerical difference\n",
        "formula. Near an endpoint, it is acceptable here to evaluate a small extension only\n",
        "because the displayed mathematical expression is smooth there; such a check does not\n",
        "assert that extrapolated values describe additional physical cases."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-015",
      "metadata": {},
      "source": [
        "input_span = 0.99\n",
        "for fraction in [1e-2, 1e-3, 1e-4]:\n",
        "    step = input_span * fraction\n",
        "    upper = float(evaluate(reference_input + step))\n",
        "    lower = float(evaluate(reference_input - step))\n",
        "    numerical_slope = (upper - lower) / (2 * step)\n",
        "    difference = numerical_slope - slope_at_reference\n",
        "    print(f\"step={step:.6g}: slope={numerical_slope:.6g}, difference={difference:.6g}\")\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-016",
      "metadata": {},
      "source": [
        "For a smooth function, reducing the step often reduces the approximation error at first.\n",
        "Very small steps can eventually make subtraction of nearly equal floating-point values\n",
        "less reliable. Therefore “smaller” is not an unlimited guarantee of “better.” Compare\n",
        "the observed behaviour over a useful range of steps instead of choosing the smallest\n",
        "number the computer can represent.\n",
        "\n",
        "An absolute slope difference is useful when the expected slope is near zero. A relative\n",
        "difference would divide by a very small reference and could look enormous even when the\n",
        "absolute discrepancy is tiny. Away from zero, a relative difference can help compare\n",
        "quantities with very different scales. The tolerance should reflect the question and\n",
        "the numerical method, rather than a universal decimal threshold copied into every test.\n",
        "\n",
        "### Change the example and preserve the reasoning\n",
        "\n",
        "Make one copy of the reference calculation before editing it. Choose a second value of\n",
        "unrounded state value inside the stated interval, predict whether display quantisation scale relative to value will rise or fall,\n",
        "and then evaluate the expression. Place the prediction and the result in a text cell.\n",
        "If they disagree, identify whether the mistake was in the sign, the unit conversion,\n",
        "the algebra, or the assumption about how the curve behaves.\n",
        "\n",
        "Next choose a shorter plotting interval around the reference point. Compare the local\n",
        "curve with its tangent approximation. Then widen the interval again. The difference\n",
        "shows why a useful local estimate need not describe the whole range. Keep the axis\n",
        "labels and numerical scale visible when comparing the plots; automatic axis limits can\n",
        "make two different effects appear equally large.\n",
        "\n",
        "Finally, return to the physical limit stated at the start: This ratio describes representation; it does not supply a physical law for entropy production. Describe one change\n",
        "to the setup that would violate that limit. State what new input, equation, or observation\n",
        "would be needed before trusting an answer in the changed situation. This last step\n",
        "connects the Python experiment to the physics instead of treating successful execution\n",
        "as the only criterion for a useful result.\n",
        "\n",
        "Before saving, restart the runtime and run all cells in order. A result that depends on\n",
        "an earlier, now-deleted input cell is not reproducible from the saved notebook. Keep\n",
        "unrounded values for later calculations, round only the reported output, and label any\n",
        "new data as measured, assumed, or generated. The graph and printed values should remain\n",
        "traceable to the same expression and the same choices of inputs.\n",
        "\n",
        "### Recover the output change by integrating the slope\n",
        "\n",
        "There is another way to check that the expression and its derivative describe the same\n",
        "relationship. Add up the small output changes predicted by the slope across the chosen\n",
        "input interval. In the continuous limit, this integral equals the output at the upper\n",
        "endpoint minus the output at the lower endpoint. The result has units of dimensionless:\n",
        "the input unit in the integration cancels the input unit in the denominator of the slope.\n",
        "\n",
        "This statement is about the mathematics of this particular relationship. It does not\n",
        "assign a new physical meaning to an arbitrary area under a graph. For example, an area\n",
        "under force versus distance represents work, while an area under a different pair of\n",
        "quantities may represent something else or have no standard name. Always carry the\n",
        "axis units through the calculation before naming an integral."
      ]
    },
    {
      "cell_type": "code",
      "id": "code-017",
      "metadata": {},
      "source": [
        "slope_function = sp.lambdify(q, slope_expression, modules=\"numpy\")\n",
        "endpoint_change = float(evaluate(1.0) - evaluate(0.01))\n",
        "for points in [101, 201, 401]:\n",
        "    grid = np.linspace(0.01, 1.0, points)\n",
        "    slopes = np.asarray(slope_function(grid), dtype=float)\n",
        "    slopes = np.broadcast_to(slopes, grid.shape)\n",
        "    integrated_change = np.trapezoid(slopes, grid)\n",
        "    print(\n",
        "        points,\n",
        "        \"integrated change:\",\n",
        "        integrated_change,\n",
        "        \"endpoint change:\",\n",
        "        endpoint_change,\n",
        "    )\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "id": "markdown-018",
      "metadata": {},
      "source": [
        "The trapezoidal rule joins neighbouring slope samples with straight segments and adds\n",
        "their signed areas. A negative contribution remains negative; replacing every slope\n",
        "by its magnitude would calculate a different quantity. Increasing the sample count\n",
        "provides a practical refinement check. If the values do not settle toward the endpoint\n",
        "difference, first inspect the interval, singularities, and array ordering.\n",
        "\n",
        "Do not conclude that two agreeing calculations prove the model is physically complete.\n",
        "Both use the same selected relationship, so an omitted effect would be omitted from\n",
        "both. Their agreement is evidence that the numerical tools implement that relationship\n",
        "consistently. Comparing with an independent experiment or a more appropriate physical\n",
        "model is a separate test.\n",
        "\n",
        "Keep this comparison in the notebook when you change the expression. It is particularly\n",
        "useful after adding a coefficient, changing a sign convention, or converting an input\n",
        "unit. A code cell that produces a smooth graph can conceal these mistakes; a second\n",
        "calculation of the same output change gives you another place to notice them.\n",
        "\n",
        "## Sources\n",
        "\n",
        "- [OpenStax, *University Physics Volume 2*, Section 3.4, “Thermodynamic Processes”](https://openstax.org/books/university-physics-volume-2/pages/3-4-thermodynamic-processes).\n",
        "- [OpenStax, *University Physics Volume 2*, Section 4.7, “Entropy on a Microscopic Scale”](https://openstax.org/books/university-physics-volume-2/pages/4-7-entropy-on-a-microscopic-scale).\n",
        "- [Benjamin Crowell, *Light and Matter*, Chapter 16, “Thermodynamics”](https://open.umn.edu/opentextbooks/textbooks/light-and-matter).\n",
        "- [Physics LibreTexts, “Thermodynamics and Statistical Mechanics”](https://phys.libretexts.org/Bookshelves/Thermodynamics_and_Statistical_Mechanics)."
      ]
    }
  ],
  "metadata": {
    "kernelspec": {
      "display_name": "Python 3",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "name": "python",
      "version": "3.12"
    },
    "colab": {
      "name": "computational-arrow-of-time.ipynb",
      "provenance": []
    },
    "tirta": {
      "lesson": "https://tirta.co/a-byte-of-physics/computational-arrow-of-time",
      "source_sha256": "9f9fafd1f9a9a9ef777c5445f94afa02fa2aba6709419f819ad5857deae731ac"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 5
}
