Watch gradient ascent find the only maxima — a hands-on tour of why maximizing the sum of 4th powers of a matrix's entries, over the orthogonal group, always ends at a clean signed permutation.
Take any orthogonal matrix Q (rows and columns are unit-length and mutually perpendicular — think rotations and reflections). Score it by adding up the 4th power of every entry:
Q ⟼ ‖Q‖₄⁴ = Σi,j qij⁴ maximized over Q ∈ O(r)
The only local maximizers — hence the only global maximizers, in every dimension r — are signed permutation matrices: exactly one entry of ±1 in each row and column, zero everywhere else. (Max score = r, since each nonzero entry contributes 1⁴ = 1.)
Every other stationary point is provably not a trap. The paper shows each one has an explicit rank-two tangent direction along which the objective's second variation is strictly positive — a built-in escape hatch that a good optimizer will find.
The proof uses a "maximum-entry pivot" argument on orthostochastic matrices and an exact Riemannian Hessian computation, handling edge cases like zero entries, repeated magnitudes, and Hadamard-type stationary points.
Why it matters: whitened Independent Component Analysis looks for an orthogonal "un-mixing" rotation, and the classic kurtosis-based contrast functions used to find it are exactly this flavor of quartic score. This theorem is the reason that landscape has no bad local optima to get stuck in — every generic starting rotation slides to a clean separation. The bonus panel below makes that concrete with two audio tones.
PANEL A Explore the landscape — SO(2)
Drag θ to rotate Q(θ) = [[cosθ,−sinθ],[sinθ,cosθ]]. Watch f(θ) = cos⁴θ+sin⁴θ+sin⁴θ+cos⁴θ = 1.5 + 0.5·cos(4θ) spike exactly at the axis-aligned rotations.
f(θ) = — (max = 2)
nearest permutation at —
PANEL B Watch it snap — gradient ascent
Riemannian gradient ascent on O(n): step along the projected gradient of ‖Q‖₄⁴, then re-orthonormalize. No matter where it starts, it slides to a signed permutation.
iteration 0
f(Q) = — (max = 2)
|∇| = —
BONUS De-scramble two tones (kurtosis-style ICA)
Two clean tones s₁(t), s₂(t) get "blindly" mixed by an unknown rotation φ into two observed channels x(t) = R(φ)·s(t) — like two microphones each picking up a blend of two instruments.
We search for a candidate un-mixing angle ψ by running the exact same gradient ascent on ‖Q‖₄⁴, now applied to the composed matrix Q(ψ) = R(ψ)·R(φ). The ascent never looks at the audio itself — it only climbs the matrix-entry landscape from Panel A/B — yet because the theorem guarantees that landscape has no bad optima, ψ reliably lands wherever ψ+φ is a multiple of 90°, i.e. R(ψ)R(φ) becomes a signed permutation and the channels pop apart into clean, separated tones (up to reordering / sign flip — the same ± freedom baked into "signed" permutation matrices).
Mixed observation x(t) — what the ears actually hear before separating