You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|[Pentagonal Lattice Geometry](experiments/Pentagon_Lattice_Geometry/index.html)| Multi-sheeted covering construction where the pentagon develops fractional dimension (d ≈ 2.37) and spinor-like holonomy |
29
29
|[Space-Color Symmetry](experiments/symmetry_simple/index.html)| A pixel canvas where symmetry rewires the diffusion graph, producing kaleidoscope dynamics on a quotient-like manifold |
30
30
|[Geometric Entropy](experiments/geometric-entropy/index.html)| A continuous analogue of the Erdős distinct-distance problem via Shannon entropy optimization |
@@ -38,7 +38,7 @@ methods.
38
38
Extended written investigations into the foundations of computational mathematics.
|[Quadratic Quasi-Newton](essays/QQN/index.html)| A new optimization algorithm interpolating between gradient descent and L-BFGS |
43
43
|[Rational Certificate Complexity](essays/RCC/index.html)| A computational taxonomy of mathematical constants, stratified by certificate cost |
44
44
|[The Simplest Increment: x + sin(x)](essays/PI_RCC/index.html)| A cubic-convergent iteration for π built from the derivative structure of an analytic function |
@@ -49,7 +49,7 @@ Extended written investigations into the foundations of computational mathematic
49
49
Compact, self-contained demonstrations of classical mathematical concepts.
Copy file name to clipboardExpand all lines: essays/PI_RCC/README.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -105,7 +105,7 @@ This gives a rational approximant to the next iterate:
105
105
y_m = x + s_m(x)
106
106
```
107
107
108
-
The sequence y_m converges to x + sin(x) as m → ∞. Each y_m is a rational number paired with a computable error bound — a _certificate_ that the true iterate lies within an explicit interval around y_m. This is, in essence, interval arithmetic with rational endpoints: the framework of validated numerics (Moore, Rump, Tucker) applied to a specific transcendental update.
108
+
The sequence y*m converges to x + sin(x) as m → ∞. Each y_m is a rational number paired with a computable error bound — a \_certificate* that the true iterate lies within an explicit interval around y_m. This is, in essence, interval arithmetic with rational endpoints: the framework of validated numerics (Moore, Rump, Tucker) applied to a specific transcendental update.
109
109
110
110
### Inner Convergence Rate
111
111
@@ -179,7 +179,7 @@ The x + sin(x) engine fits none of these categories cleanly.
179
179
180
180
It is not a hypergeometric series — the outer recurrence is nonlinear and cannot be expressed as a ratio of consecutive hypergeometric terms in the iteration index.
181
181
182
-
It is not a Newton method — Newton's method for sin(x) = 0 gives x\_{n+1} = x_n − tan(x_n), a different map with different structure that requires evaluating _both_ sin and cos and performing a division. The x + sin(x) iteration achieves cubic convergence without division and without derivative evaluation.
182
+
It is not a Newton method — Newton's method for sin(x) = 0 gives x\_{n+1} = x*n − tan(x_n), a different map with different structure that requires evaluating \_both* sin and cos and performing a division. The x + sin(x) iteration achieves cubic convergence without division and without derivative evaluation.
183
183
184
184
It is not an AGM — there is no arithmetic-geometric mean in sight.
Copy file name to clipboardExpand all lines: essays/PI_RCC/perspectives.details.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,7 +28,7 @@ e_{n+1} = (1/6)e_n³ + O(e_n⁵)
28
28
29
29
is standard. However, several numerical analysis subtleties deserve sharper treatment:
30
30
31
-
**Basin of Attraction**: The cubic convergence holds only within a neighborhood of π where the Taylor expansion is valid _and_ where the cubic term dominates. Specifically, we need |e_n| small enough that the O(e_n⁵) term is negligible relative to e_n³/6. This requires roughly |e_n| < 1, but the _practical_ basin where cubic behavior is observed requires |e_n| ≲ 0.1 to avoid the quintic correction term contributing more than ~1% of the cubic term. The document glosses over the seed quality requirement.
31
+
**Basin of Attraction**: The cubic convergence holds only within a neighborhood of π where the Taylor expansion is valid _and_ where the cubic term dominates. Specifically, we need |e*n| small enough that the O(e_n⁵) term is negligible relative to e_n³/6. This requires roughly |e_n| < 1, but the \_practical* basin where cubic behavior is observed requires |e_n| ≲ 0.1 to avoid the quintic correction term contributing more than ~1% of the cubic term. The document glosses over the seed quality requirement.
32
32
33
33
**Pre-asymptotic Behavior**: For seeds far from π, the iteration x + sin(x) is not contractive everywhere. The map has derivative 1 + cos(x), which equals 2 at x = 0 and is expansive for x ∈ (−π/2, π/2). A naive seed of x₀ = 3 gives e₀ ≈ 0.14, which is already in the cubic regime. But x₀ = 1 would diverge initially before potentially being captured. The document's claim of "start with a seed sufficiently close to π" needs quantification.
34
34
@@ -966,7 +966,7 @@ Option 3 is the correct engineering choice and also reveals a deeper point: **ra
966
966
967
967
The document glosses over a critical implementation challenge: **the iteration requires a seed sufficiently close to π**. This is a bootstrapping problem.
968
968
969
-
For cubic convergence to dominate, we need |e_0| < 1 (roughly). But to get a _certified_ rational seed, we need an independent method. Options:
969
+
For cubic convergence to dominate, we need |e*0| < 1 (roughly). But to get a \_certified* rational seed, we need an independent method. Options:
Copy file name to clipboardExpand all lines: essays/PI_RCC/socratic.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -210,7 +210,7 @@ The convergents p_k/q_k of a continued fraction are generated by the recurrence:
210
210
- p*k = a_k · p*{k-1} + p\_{k-2}
211
211
- q*k = a_k · q*{k-1} + q\_{k-2}
212
212
213
-
The best-approximation property — that p_k/q_k satisfies |α - p_k/q_k| < 1/q_k² and that no rational with smaller denominator does better — is _proved_ by induction on the iterative structure. The certificate is not a static object that the iteration merely happens to visit. The iteration _generates_ the certificate inductively. You cannot separate the optimality result from the recursive construction without losing the proof.
213
+
The best-approximation property — that p*k/q_k satisfies |α - p_k/q_k| < 1/q_k² and that no rational with smaller denominator does better — is \_proved* by induction on the iterative structure. The certificate is not a static object that the iteration merely happens to visit. The iteration _generates_ the certificate inductively. You cannot separate the optimality result from the recursive construction without losing the proof.
214
214
215
215
So my claim that certification "points toward static optimality criteria fully separable from any iteration" was wrong in the continued fraction case. I was treating the _statement_ of the theorem as separable from its _proof structure_, which is a mistake.
Copy file name to clipboardExpand all lines: essays/QQN/papers/intro/paper_rendered.md
+26-29Lines changed: 26 additions & 29 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -104,7 +104,7 @@ This paper makes three primary contributions:
104
104
2
105
105
106
106
3. Benchmarking Framework: A reusable Rust application for optimization algorithm evaluation that
107
-
promotes reproducible research and meaningful comparisons.
107
+
promotes reproducible research and meaningful comparisons.
108
108
109
109
Optimal configurations remain problem-dependent, but QQN’s adaptive nature minimizes the need for
110
110
extensive hyperparameter tuning. Scaling and convergence properties are theoretically justified, largely
@@ -164,8 +164,7 @@ that traces a path from the current point. We impose three natural boundary cond
164
164
descent)
165
165
3. Terminal Position: d(1) = dLBFGS (the curve ends at the L-BFGS direction)
166
166
167
-
168
-
The second condition is crucial: by ensuring the path starts tangent to the negative gradient, we guarantee
167
+
The second condition is crucial: by ensuring the path starts tangent to the negative gradient, we guarantee
169
168
170
169
that moving along the path initially decreases the objective function, regardless of where the path eventually
171
170
leads. This provides robustness against poor quasi-Newton directions.
@@ -628,23 +627,23 @@ consistently outperformed other optimizer families across the benchmark suite.
628
627
629
628
12
630
629
631
-
3. Line Search Critical: Among QQN variants, line search strategy dramatically affects performance:
630
+
3.Line Search Critical: Among QQN variants, line search strategy dramatically affects performance:
632
631
633
632
• Strong Wolfe: Excellent success rate with moderate average evaluations
634
633
• Golden Section: 90-100% success rate on 2D problems with relatively few average evaluations
635
634
• Bisection: Strong performance on various problems with minimal evaluations
636
635
• Bisection: Strong performance on various problems with minimal evaluations
637
636
• Cubic-Quadratic Interpolation: 70% success on Rosenbrock 5D, good for ill-conditioned objectives
638
637
639
-
4. Problem-Specific Excellence: Algorithms show significant specialization:
638
+
4.Problem-Specific Excellence: Algorithms show significant specialization:
640
639
641
-
• QQN-GoldenSection: Achieved strong performance on multimodal problems
642
-
• QQN-GoldenSection: Achieved strong performance on multimodal problems
643
-
• QQN-CubicQuadraticInterpolation: 70% success on Rosenbrock 5D with strong performance on
644
-
ill-conditioned problems
645
-
• Adam-WeightDecay: Excellent performance on neural networks vs moderate performance for
646
-
standard Adam
647
-
• L-BFGS variants: Generally poor performance on ill-conditioned problems like Rosenbrock
640
+
• QQN-GoldenSection: Achieved strong performance on multimodal problems
641
+
• QQN-GoldenSection: Achieved strong performance on multimodal problems
642
+
• QQN-CubicQuadraticInterpolation: 70% success on Rosenbrock 5D with strong performance on
643
+
ill-conditioned problems
644
+
• Adam-WeightDecay: Excellent performance on neural networks vs moderate performance for
645
+
standard Adam
646
+
• L-BFGS variants: Generally poor performance on ill-conditioned problems like Rosenbrock
648
647
649
648
7.2 The Benchmarking and Reporting Framework
650
649
7.2.1 Methodological Contributions
@@ -796,15 +795,15 @@ demonstrates:
796
795
797
796
15
798
797
799
-
3. Efficiency vs Robustness: QQN shows superior efficiency with strong success rates across problem
800
-
types while requiring fewer function evaluations than traditional methods. 4. Theoretical Foundation: Rigorous proofs establish global convergence under mild assumptions and
801
-
local superlinear convergence matching quasi-Newton methods.
798
+
3.Efficiency vs Robustness: QQN shows superior efficiency with strong success rates across problem
799
+
types while requiring fewer function evaluations than traditional methods. 4. Theoretical Foundation: Rigorous proofs establish global convergence under mild assumptions and
800
+
local superlinear convergence matching quasi-Newton methods.
802
801
803
-
5. Practical Impact: The results provide clear guidance for practitioners: use QQN-StrongWolfe for
804
-
general optimization, QQN-Bisection variants for high-dimensional problems, QQN-GoldenSection for
805
-
multimodal landscapes, and QQN-CubicQuadraticInterpolation for sparse or ill-conditioned problems.
802
+
5. Practical Impact: The results provide clear guidance for practitioners: use QQN-StrongWolfe for
803
+
general optimization, QQN-Bisection variants for high-dimensional problems, QQN-GoldenSection for
804
+
multimodal landscapes, and QQN-CubicQuadraticInterpolation for sparse or ill-conditioned problems.
806
805
807
-
The simplicity of QQN’s core insight—that quadratic interpolation provides the natural geometry for
806
+
The simplicity of QQN’s core insight—that quadratic interpolation provides the natural geometry for
808
807
809
808
combining optimization directions—contrasts with the complexity of recent developments. Combined with
810
809
our evaluation methodology, this work establishes new standards for both algorithm development and em-
@@ -1036,13 +1035,13 @@ We seek a principled method to combine these directions that:
1036
1035
3. Requires no additional hyperparameters
1037
1036
4. Maintains computational efficiency
1038
1037
1039
-
14.1.2 B.1.2 Geometric Formulation
1040
-
We formulate direction combination as a boundary value problem in parametric space. Consider a parametric
1041
-
curve d : [0, 1] → Rn satisfying:
1038
+
14.1.2 B.1.2 Geometric Formulation
1039
+
We formulate direction combination as a boundary value problem in parametric space. Consider a parametric
arithmetic. 2. L-BFGS direction: The two-loop recursion requires O(mn) operations to compute Hk ∇f (xk ). 3. Line search: Each function evaluation along the path requires O(n) operations to compute xk + d(t),
1247
-
plus the cost of evaluating f .
1245
+
arithmetic. 2. L-BFGS direction: The two-loop recursion requires O(mn) operations to compute Hk ∇f (xk ). 3. Line search: Each function evaluation along the path requires O(n) operations to compute xk + d(t),
1246
+
plus the cost of evaluating f .
1248
1247
1249
1248
Total complexity per iteration: O(mn + kn) + k · cost(f ). □
1250
1249
@@ -1337,5 +1336,3 @@ dquasi-Newton if condition B
1337
1336
QQN provides continuous interpolation, eliminating discontinuities and the need for switching logic.
0 commit comments