Skip to content

Latest commit

 

History

History
329 lines (214 loc) · 24.1 KB

File metadata and controls

329 lines (214 loc) · 24.1 KB
title The Budget Governor Principle
subtitle Technical Note on Control-Knob Sufficiency, Low-Dimensional Generalization, Inverse Recovery, and Symmetry-Limited Pose-Free Inference
author Dionisio Alberto Lopez III
date March 29, 2026
documentclass article
fontsize 11pt
geometry margin=1in
numbersections true
bibliography references.bib
link-citations true
colorlinks true
abstract The Budget Governor Principle (BGP) is the experimentally established control-parameter law for the symmetric constant-sum two-source Euclidean process. In that base case, BGP is the latent control parameter `e = c/a` for normalized geometry and `b/a = sqrt(1-e^2)` is the corresponding transverse residue. In the tested base case, `e = c/a` is not only a descriptor of the finished boundary; it is the allocation readout of how much fixed total budget is consumed by separation before transverse residue remains. Controlled computational studies in this repository show that this parameter governs normalized shape, remains recoverable from noisy boundary observations when the source positions are known, and outperforms raw separation and raw budget variables under scale shift. Additional studies show that the same budget logic extends in a structured way: asymmetry upgrades the family from one knob to two, the hyperbola case yields a deficit-side twin, controlled anisotropy adds a medium parameter removable by whitening, and equal-weight and weighted three-source families are governed by compact normalized control objects. In weighted multi-source and anisotropic settings those control objects form operational latent variables recoverable from boundary data. The pose-free anisotropic inverse remains the hardest tested branch, but the focused bottleneck slice is now solved in the tested regime by the entropy-gated bank ensemble solver. On the solved slice (`sparse_full_noisy` and `sparse_partial_high_noise`, moderate anisotropy, `low_skew` / `mid_skew` / `high_skew`), the solver achieves holdout mean `alpha` error `0.1050` versus best single `0.1091` and confirmation mean `alpha` error `0.1064` versus best single `0.1104`. The remaining open work is broader regime generalization, broader validation, unknown-axis media, richer media, and outward extension.

Keywords: ellipse eccentricity; conic geometry; inverse problems; latent variables; anisotropy; multi-source geometry; scale collapse; shape analysis

Opening Statement

BGP is the latent control parameter e = c/a for the symmetric constant-sum two-source Euclidean process.

The repository establishes that base case, extends the same budget logic into compact low-dimensional control objects for richer families, and demonstrates boundary-only recovery of those control objects in weighted multi-source settings [@shapebudget2026]. In the tested base case, the boundary is the visible residue of a prior budget allocation and e = c/a is the readout recovered from that residue.

The established result set is:

  • in the symmetric two-source base case, e = c/a governs normalized geometry
  • in that same setting, boundary data recovers e and e outperforms raw separation and raw budget variables under scale shift
  • beyond the base case, asymmetry, anisotropy, and multi-source families are still governed by compact normalized control objects
  • in the hardest tested pose-free anisotropic branch, the focused moderate sparse slice is now solved in the tested regime by a solver-policy change rather than a larger control object

Core Proposal

The narrowest version of BGP is the symmetric constant-sum two-source Euclidean process:

$$ |x-F_1| + |x-F_2| = 2a $$

with focal half-separation c. In that setting, the governor variable is

$$ e = \frac{c}{a}, $$

defined as a normalized separation load. The corresponding transverse residue is

$$ \frac{b}{a} = \sqrt{1-e^2}. $$

This gives the base case an inverse reading. The ellipse boundary is not the primary hidden object. It is the visible residue of a prior allocation decision under fixed total budget. In that tested regime, eccentricity is best read as the allocation readout c/a, not merely as a post hoc label attached to a finished curve.

The core BGP reading is therefore:

normalized source separation relative to total budget governs how much geometric freedom remains after structural separation cost is paid.

In the symmetric ellipse case, that control object collapses to one scalar. In richer settings, the scalar does not survive unchanged, but the underlying budget logic survives in the form of compact control manifolds built from normalized placement, participation, and medium structure.

Why This Matters Computationally

The computational importance of BGP is narrower and stronger than static shape description. In the tested base case, the inverse target is not only a shape label. It is the hidden budget allocation whose residue survives in the boundary:

  1. the symmetric ratio e = c/a is the sufficient organizing variable for normalized geometry in the tested base case,
  2. that variable is operational in recovery and prediction,
  3. once symmetry is broken or the source family expands, the collapse does not dissolve chaotically but upgrades to low-dimensional control objects,
  4. and in weighted multi-source settings those compact objects can be inferred from boundary data.

The project establishes that budget-normalized latent structure governs the tested shape families in a reusable way.

Mathematical Core: The Symmetric Control Knob

The foundation experiment in this repository tests the strongest mathematical heart of the idea:

  • process reconstruction from the constant-sum two-circle construction,
  • scale collapse at fixed e,
  • one-dimensional response curves for normalized observables,
  • and a full separation-budget phase map.

The result is clean. Across the sweep:

  • maximum ellipse-equation residual was 1.5876e-14,
  • maximum pairwise scale-collapse error after normalization was 3.9736e-08,
  • and normalized width, perimeter, and tip-response observables behaved as functions of e alone within numerical tolerance.

Scale collapse in the symmetric two-source case. Fixed e produces the same normalized locus across absolute scales, which is the cleanest visual statement of one-knob sufficiency in the tested process.{ width=92% }

This is the narrowest claim the repository now establishes:

under the symmetric constant-sum two-source Euclidean process, e = c/a is the sufficient control variable for normalized geometry.

That is the base-case result.

Operational Evidence in the Symmetric Setting

The next question is whether the control knob is operational, not only compact.

The known-source inverse experiment shows that e is recoverable from noisy, partial, and sparse boundary observations with high accuracy. Mean absolute recovery error ranged from 1.46e-4 in the easiest setting to 3.46e-3 in the harshest tested setting, and even the worst 95th-percentile error remained about 1.26e-2.

The same study also compared e against raw alternatives under a scale-held-out prediction split. For normalized perimeter, for example, test RMSE was 1.90e-4 using e alone, versus 5.59e-1 for a low-capacity model on (d, S), 3.64 for raw d, and 5.65 for raw S.

Scale-held-out baseline comparison. The normalized ratio e preserves predictive power across scale far better than raw separation, raw budget, or a low-capacity model on both together.{ width=92% }

This is the first operational inverse result in the repository.

The edge-regime study sharpened that result further. Near e = 0, several shape summaries are first-order flat, so low-depletion systems are intrinsically hard to distinguish from shape alone. Near e = 1, width and major-tip response become much sharper probes than perimeter. The measured crossover points were:

  • e = 0.57735 for major-tip response,
  • e = 0.70711 for width,
  • e = 0.90891 for perimeter.

So in the symmetric setting, the budget ratio governs not only the shape family but also which probes are most useful for inverse recovery.

Structured Generalization Beyond One Knob

The next stage of the work tested whether the control law survives outside the exact symmetric ellipse case.

The first asymmetry pilot replaced the symmetric budget rule with a weighted split and found a clean structured upgrade:

  • one-knob sufficiency fails under asymmetry,
  • but a two-parameter family (e, w) collapses cleanly across scale,
  • with maximum two-knob collapse error 3.7196e-08.

Asymmetry does not destroy the budget-governed structure; it upgrades it. Fixed e with varying weight w gives different normalized shapes, while fixed (e, w) still collapses across scale.{ width=92% }

This is exactly the kind of result one wants if the principle is tracking real process structure at the family level.

The nearby extensions also stayed structured:

  • the fixed-difference twin produced a hyperbola family with one-knob collapse under lambda = a/c,
  • controlled quadratic anisotropy upgraded the raw family to (e, alpha) and whitening restored the original one-knob collapse,
  • the equal-weight three-source case was organized by the normalized source triangle relative to budget and remained strongly low-dimensional,
  • and the weighted three-source case was organized by the normalized source triangle plus the weight simplex, with the broad family behaving like a low-dimensional roughly five-parameter manifold.

The important point is that the principle did not survive as “still one scalar everywhere.” It survived as a low-dimensional allocation geometry.

From Descriptor To Operational Latent Variable

The most important shift in the repository is inferential, not geometric.

The deeper shift is not only from descriptor to latent variable. It is from treating the boundary as the primary object to treating it as compressed evidence about hidden allocation structure.

In the weighted three-source canonical-pose inverse, a simple boundary-only reference-bank inverse recovered the normalized source triangle and normalized weights with useful accuracy:

  • mean geometry MAE ranged from 0.062 to 0.086,
  • mean weight MAE ranged from 0.086 to 0.125,
  • and the weighted inverse beat an equal-weight baseline by about 1.88x to 5.53x depending on regime.

Weighted three-source inverse. The compact control object is not only a forward description of the family; it can be recovered from boundary data and clearly outperforms the equal-weight shortcut.{ width=92% }

That is the point where the project stopped being only about how to describe shape and became about what hidden state can be inferred from it.

The controlled anisotropic extension strengthened that reading further. In the canonical-pose weighted anisotropic inverse:

  • geometry MAE stayed around 0.077 to 0.089,
  • weight MAE stayed around 0.081 to 0.133,
  • mean alpha error stayed around 0.018 to 0.064,
  • and the anisotropy-aware inverse beat the Euclidean weighted shortcut by about 7.6x to 14.0x.

That is strong evidence that medium structure can join geometry and participation as part of the same operational latent object.

Pose-Free Anisotropy and the Focused Solver Milestone

The hardest tested branch is the pose-free anisotropic inverse, where unknown rotation and unknown medium anisotropy appear together.

In that combined-nuisance setting, the latent object remains operational but unevenly so:

  • geometry MAE stayed around 0.071 to 0.104,
  • weight MAE stayed around 0.138 to 0.166,
  • but mean alpha error rose to about 0.146 to 0.304.

This is not a uniform collapse of the inverse. It is a selective weakness along the anisotropy direction.

The matched ambiguity study made that diagnosis much sharper. Hiding rotation broadened the top-10 alpha envelope by about 3.7x to 5.6x and worsened best-alpha error by about 11.4x to 31.0x, while geometry dispersion stayed essentially unchanged.

The oracle alignment ceiling then showed that the missing signal is largely still there. Giving the inverse the true pose improved alpha by about 5.65x to 13.21x across all regimes while leaving geometry roughly stable.

The evidence therefore points to a symmetry-limited inverse, not a missing-signal inverse. Once pose is hidden, distinct latent states become much less separable in the pose-free observation, and that folding is concentrated much more strongly along alpha than along geometry.

Oracle alignment ceiling. Once true pose is restored, most of the lost anisotropy signal comes back, which means the main solver challenge is practical symmetry handling rather than missing information in the boundary.{ width=92% }

The newest failure-map result puts a shape on that solver challenge:

  • full observations are the only region where simple practical locking stays broadly non-negative on oracle-gain capture,
  • high-skew geometries are friendlier than low-skew and mid-skew ones,
  • weak anisotropy is easier than moderate or strong anisotropy,
  • and the main failure zones are sparse or partial observations with low-to-mid geometry skew.

Alignment failure map. Practical pose handling fails in specific regions rather than uniformly, which means the remaining problem is now localized enough to target directly.{ width=92% }

A cross-artifact phase split sharpens that diagnosis further. The calibration-frozen ambiguity gate from the shadow ensemble study and the calibration-frozen anchored-uncertainty gate from the backbone observability layer do not define the same object. Together they separate three regimes in the focused slice:

  • low ambiguity,
  • gauge-broad trials that are wide before anchoring but narrow after the backbone is fixed,
  • and bundle-broad trials that stay wide even after anchoring.

In plain language, many of the hard trials look broad at first only because pose ambiguity is still mixed into the candidate family. Once the geometry backbone is anchored, a large fraction of that width collapses, and the truly hard remainder is the smaller subset that stays broad even after that anchor. What is missing in those broad cases is not raw boundary signal by itself but enough symmetry-breaking context to make the allocation-and-medium state point-unique.

In the current 72-trial focused dataset, 63 trials are ambiguity-high. But 44 of those 63 are gauge-broad rather than bundle-broad. Their point-recoverable rate is 0.5909. The remaining 19 bundle-broad trials have point-recoverable rate 0.0526. So the hard branch is not one continuous confidence loss. Most of the observed width is a gauge-broad phase that the backbone mostly quotients out, while a smaller subset remains truly bundle-broad after anchoring.

Pose-free alpha phase map. Pre-anchor ambiguity and post-anchor anchored-width separate the focused branch into low-ambiguity, gauge-broad, and bundle-broad regimes. The key split is that many wide pre-anchor families collapse after backbone anchoring, while a smaller subset stays wide and remains largely non-pointable.{ width=96% }

The gate-control consequence is equally narrow. Ambiguity and entropy are not redundant solver signals. On fresh blocks, the largest chooser headroom sits where both pre-anchor ambiguity and dense-joint entropy are high. The both-high quadrant has mean oracle gain 0.0665 over the default candidate, versus 0.0365 in the entropy-high ambiguity-low quadrant and 0.0049 in the ambiguity-high entropy-low quadrant. That is why ambiguity alone does not replace the working entropy gate: ambiguity measures structural load, while entropy measures whether richer chooser freedom is likely to pay off.

Fresh-block gate control map. Ambiguity measures structural load and entropy measures chooser opportunity. The strongest gains sit where both axes are high, which explains why an ambiguity gate alone does not beat the current entropy-gated solver under the frozen shadow protocol.{ width=96% }

That diagnosis set up the later solver result. The entropy-gated bank ensemble solver now resolves the focused slice in the tested regime:

  • sparse_full_noisy
  • sparse_partial_high_noise
  • moderate anisotropy
  • low_skew, mid_skew, high_skew

The experiments show a solver-policy result in that tested slice. The four-way chooser and the entropy gate threshold were fit on calibration blocks only and then frozen before disjoint holdout and confirmation evaluation. The gate opens when d_joint_entropy >= 0.3655148794219478 and otherwise returns dense_support. When the gate opens, the solver selects one cached candidate rather than averaging bank outputs.

On disjoint evaluation blocks it achieved:

  • holdout mean alpha error 0.1050 versus best single cached candidate 0.1091
  • confirmation mean alpha error 0.1064 versus best single cached candidate 0.1104

Under the matched frozen shadow protocol, the entropy gate also beat the ambiguity-gated alternative on fresh combined data: 0.105721 versus 0.116399 mean alpha error.

Per-cell results remain mixed, so this is not a claim that the gate beats the best single candidate in every sub-condition. The supported claim is narrower: the latent structure survives, the focused moderate sparse bottleneck yields to a better inverse policy in the tested regime, and the remaining open work is broader than that solved slice.

What The Repo Establishes

The repo now establishes the following results.

  1. In the symmetric constant-sum two-source Euclidean process, e = c/a is the sufficient control variable for normalized geometry, and b/a = sqrt(1-e^2) is the corresponding transverse residue.
  2. In that same symmetric known-source setting, e is operational: it is recoverable from noisy boundary observations and strongly outperforms raw separation and raw budget variables under scale shift.
  3. Beyond the symmetric ellipse case, the budget-governor principle extends in a structured way. Asymmetry upgrades the family from one knob to two, controlled anisotropy adds a medium parameter, and three-source families are governed by compact normalized control objects rather than by one scalar.
  4. In weighted multi-source settings, normalized geometry plus normalized participation forms an operational latent variable recoverable from boundary data.
  5. In controlled anisotropic settings, medium structure can join that latent variable, and most of the current pose-free anisotropy penalty is a symmetry-handling problem rather than an absence-of-signal problem.
  6. In the focused pose-free anisotropic slice (sparse_full_noisy and sparse_partial_high_noise, moderate anisotropy, low_skew / mid_skew / high_skew), an entropy-gated bank ensemble solver resolves the tested bottleneck without enlarging the latent control object.

That is already a much larger result set than the original concept note.

Limits And Scope

This note is still narrower than a finished general theory.

These results are based on controlled computational studies. The strongest exact mathematical statement remains the symmetric two-source Euclidean core. Most of the richer claims are empirical structural claims established by numerical experiments rather than formal proofs.

The inverse results are also intentionally structured:

  • finite reference banks rather than full continuous optimizers,
  • radial-signature encodings rather than arbitrary boundary representations,
  • controlled anisotropy rather than arbitrary warped media,
  • and mostly three-source families rather than unrestricted source count.

The repository leaves these targets unresolved:

  • universal sufficiency of one scalar beyond the symmetric ellipse case,
  • broader regime coverage and broader fresh-bank validation outside the solved focused slice,
  • recovery under arbitrary anisotropy-axis orientation,
  • full robustness under richer non-quadratic or spatially varying media,
  • or extension of the same control-object logic to harder source families and outward application tests.

Those are real unresolved technical targets, not wording details.

Practical Interpretation

The practical use of BGP is not “always compute eccentricity.”

The practical use is:

  • identify the compact normalized budget variables that govern a family,
  • use them as the primary state for prediction and comparison,
  • and in inverse settings, ask whether the observed boundary is sufficient to recover that hidden budget object.

In the symmetric two-source case, that means e is a real control coordinate and even tells you which probes are worth trusting at different depletion phases.

In the richer multi-source and anisotropic families, the same logic becomes:

  • normalized placement,
  • normalized participation,
  • and sometimes medium structure

are better state variables than raw distances, raw scale, or unstructured shape summaries.

The main practical engineering lesson from the current phase is just as important:

when one part of the hidden budget state becomes weakly identifiable, the right next move is a better inverse policy that respects observability structure before assuming the latent control object itself must change.

Open Technical Targets

The strongest next steps are:

  1. validate and extend the entropy-gated solver beyond the solved focused slice into broader support and anisotropy regimes,
  2. test fresh-bank stability and broader holdout behavior outside the current moderate sparse slice,
  3. extend the medium branch beyond a single axis-aligned anisotropy parameter,
  4. test richer non-quadratic or spatially varying media,
  5. and begin out-of-family application tests that use BGP as an inferential control object rather than only a geometric control law.

Conclusion

The narrow mathematical heart of the project is the symmetric two-source result: e = c/a is the budget governor for normalized geometry. The repository now establishes a broader result set as well. The same budget logic extends into low-dimensional control objects for asymmetric, anisotropic, and multi-source families, and in weighted inverse settings those objects form operational latent variables.

The hardest tested inverse branch is also in a better place than it was at the start. The focused moderate sparse bottleneck in the pose-free anisotropic branch is now solved in the tested regime by the entropy-gated bank ensemble solver. The remaining solver work is broader validation and broader extension, not whether the latent state exists or whether the solved focused slice can be closed at all.

That is a strong place for the program to be. BGP now functions as a technical framework for how budget-constrained geometry is organized and how much of that hidden organization can be recovered from what we observe.

Artifact References