alphaFeedback

WorksMathematics

An Upper Bound of 9/4 for the Matrix Multiplication Exponent

AI contributions
  • unreleased internal OpenAI model
View details
Ancillary data
Formal proof, 4 proof or workflow links
View

Abstract

We prove that the exponent of matrix multiplication over the complex numbers is at most 9/49/4.

Introduction

The exponent ω\omega of matrix multiplication over C\mathbb{C} is the infimum of the real numbers τ\tau such that, for every ε>0\varepsilon> 0, two n×nn \times n matrices can be multiplied in Oε(nτ+ε)O_{\varepsilon}(n^{\tau+\varepsilon}) scalar arithmetic operations. The dimension nn tends to infinity; the algorithm and its constants may depend on ε\varepsilon. We prove the following bound.

Theorem 1.1. For every ε>0\varepsilon> 0, two n×nn \times n complex matrices can be multiplied using Oε(n9/4+ε)O_{\varepsilon}(n^{9/4+\varepsilon}) arithmetic operations. In particular, ω≤9/4\omega\le9/4.

Strassen’s seven-product algorithm for two-by-two matrices showed that recursion can reduce the arithmetic exponent below three [13]. Bilinear algorithms can be represented by trilinear coefficient arrays, or tensors; linear substitutions and tensor products then express reductions and recursive composition. Approximate bilinear algorithms enlarge the available constructions, and Bini’s interpolation argument converts them into exact asymptotic algorithms [3]. Schönhage’s asymptotic sum inequality turns efficient simultaneous computations of independent matrix products into bounds on the exponent [11]. Strassen’s laser method extracts such independent products from tensor powers [14, 15]. His asymptotic spectrum describes asymptotic tensor comparisons through numerical invariants compatible with sums, products, and restrictions [16, 4].

Coppersmith and Winograd combined tensor powers with progression-free sets to extract independent products from an auxiliary form [5]. Higher-power analyses by Stothers [12] and Davie–Stothers [6], Vassilevska Williams [18], and Le Gall [10] developed this construction; Le Gall formulated its analysis through convex optimization. Alman and Vassilevska Williams refined the extraction of independent components [2]. Duan, Wu, and Zhou analyzed losses caused by combining components across recursion levels [7]. Further asymmetric analyses by Vassilevska Williams, Xu, Xu, and Zhou [19] and Alman et al. [1] improved the resulting bounds. Dupont et al. report ω<2.371177\omega< 2.371177 by optimizing this combination-loss framework [8].

The present proof combines explicit tensor degenerations with the spectral viewpoint. It derives inequalities for character values on polynomial multiplication, then uses their discrete growth to bound the values on matrix multiplication. Interpolation, counting words with prescribed frequencies, and balancing the tensor legs retain their roles from the earlier tensor-power methods. The central finite construction here separates blocks that already have independent variables on two of their three legs. Theorem 1.1 concerns the asymptotic arithmetic exponent; its proof does not specify a competitive finite matrix size.

Separation and polynomial multiplication. The three variable groups of a trilinear form are called legs. A basic difficulty in tensor constructions is that useful pieces can share variables. A full direct sum requires independent variables on all three tensor legs. Our principal construction starts with blocks that are independent on two legs and share the third. A finite Fourier projection supplies a tentative block label on the shared leg, and a degeneration whose total weight is the square of the label mismatch retains exactly the correct labels. The resulting independent blocks each carry an auxiliary dot product. The number of output blocks compensates for the cost of the Fourier copies at the exponential scale. Proposition 3.1 and Corollary 3.2 give this construction and its entropy consequence for arbitrary tensors with this block structure.

We apply the separation inequality to ordinary polynomial multiplication. A determinant filtration compares neighboring input degrees, while a three-sector decomposition compares one input length with roughly three times that length. The determinant filtration is preserved by every multiplication map, so one choice of bases and weights works simultaneously for all first-input slices.

Route to the exponent. We use Strassen’s spectral viewpoint [16, 4]: tensor characters are normalized numerical invariants that add on direct sums, multiply on tensor products, and are monotone under restriction. The detecting-character result, Lemma 2.2, makes it sufficient to bound these invariants on matrix multiplication for every character. Each character has value n3tn^{3t} there for a positive parameter tt. Multiplication of polynomials with coefficient vectors of lengths a,ba,b has an output vector of length a+b−1a+b-1. We measure this tensor by a normalized geometric mean of its character values under all six permutations of the legs. The resulting profile P(a,b)P(a,b) is positive and symmetric in the input lengths. Polynomial interpolation gives P(a,b)≤(a+b−1)1/tP(a,b) \leq(a+b-1)^{1/t}. The two constructions above show that its successive increments do not increase in either input length and that

P(a,3h+a−1)≥3P(a,h).P(a,3h+a-1) \geq3P(a,h).

Together with P(1,b)=bP(1,b)=b, these properties force P(a,a)≥a4/3P(a,a) \geq a^{4/3}. Comparing the two growth rates yields t≤3/4t \leq3/4, hence 3t≤9/43t \leq9/4.

Section 2 introduces the character framework and states the required existence result. Section 3 proves the separation inequality, and Section 4 derives the two polynomial inequalities. Section 5 proves the discrete growth estimate and completes the arithmetic argument. Appendix A gives a complete proof of the character-existence result used here.

Tensors and their characters

We first describe the numerical invariants to which the constructions will be applied. Throughout, tensors are finite trilinear forms over C\mathbb{C}. Their three variable groups are called the XX-, YY-, and ZZ-legs. A restriction applies an independent linear substitution on each leg. We write A≥BA \geq B if BB is a restriction of AA.

The tensor product multiplies coefficient arrays and pairs the corresponding variable indices on each leg. Let SS be the set of tensors modulo mutual restriction. Full direct sum and tensor product make SS a commutative semiring, and restriction induces an order compatible with both operations. We write products either by juxtaposition or by ⊗\otimes. The zero tensor is 00, the scalar tensor xyzxyz is 11, and the integer m≥0m \geq0 denotes the direct sum of mm copies of 11. Thus mA=A⊕mmA=A^{\oplus m}. In a full direct sum, the summands have disjoint variables on all three legs.

The tensor rank R(A)R(A) is the least integer mm with m≥Am \ge A. It is finite by expansion in bases. Every nonzero tensor restricts to 1, by evaluating its three arguments on suitable lines, so

R(A)≥A≥1(A≠0).(1)R(A) \ge A \ge1 \qquad(A \ne0). \tag*{(1)}

Rank is monotone, subadditive, and submultiplicative. We do not assume its additivity. A leg flattening is the matrix obtained by placing that leg against the pair of other legs. Its matrix rank is restriction-monotone, additive on full direct sums, and multiplicative on tensor products.

The trilinear form encoding n×nn \times n matrix multiplication and its exact-rank exponent are

Tn=∑i,j,k=1nxijyjkzki,ν=inf⁡n≥2log⁡nR(Tn).(2)T_n = \sum_{i,j,k=1}^{n} x_{ij}y_{jk}z_{ki}, \qquad\nu= \inf_{n \ge2} \log_n R(T_n). \tag*{(2)}

Reindexing identifies TnTmT_nT_m with TnmT_{nm}. Flattening and the displayed expansion give n2≤R(Tn)≤n3n^2 \le R(T_n) \le n^3, so 2≤ν≤32 \le\nu\le3 and R(Tn)≥nνR(T_n) \ge n^\nu. At the end of the proof we convert the bound on ν\nu into the asserted arithmetic bound.

Definition 2.1. A tensor character is an additive, multiplicative, restriction-monotone map λ:S→R≥0\lambda: S \to\mathbb{R}_{\ge0} with λ(1)=1\lambda(1) = 1.

The three flattening ranks are examples. Characters are the spectral points of the tensor semiring [16, 4]. They satisfy λ(m)=m\lambda(m) = m and 1≤λ(A)≤R(A)1 \le\lambda(A) \le R(A) for A≠0A \ne0. The following special case of spectral separation is the only existence statement needed. Its proof in Appendix A uses finite dimensional separation, compactness, and a fixed-point theorem.

Lemma 2.2 (Detecting characters). Let d≥2d \ge2 and k≥0k \ge0 be integers with k<dνk < d^\nu, where ν\nu is defined by (2). There is a tensor character λ\lambda with λ(Td)≥k\lambda(T_d) \ge k.

Dot-product exponents

For m≥1m \ge1, define the oriented dot products by

BX(m)=x∑i=1myizi,B_X(m) = x\sum_{i=1}^{m} y_i z_i,

and BY(m)B_Y(m), BZ(m)B_Z(m) obtained by cyclically permuting the legs. For any character there are numbers pX,pY,pZ∈[0,1]p_X, p_Y, p_Z \in[0,1] such that

λ(BX(m))=mpX,λ(BY(m))=mpY,λ(BZ(m))=mpZ.\lambda(B_X(m)) = m^{p_X}, \qquad\lambda(B_Y(m)) = m^{p_Y}, \qquad\lambda(B_Z(m)) = m^{p_Z}.

Indeed, f(m)=λ(BX(m))f(m) = \lambda(B_X(m)) is positive and nondecreasing, satisfies f(mn)=f(m)f(n)f(mn) = f(m)f(n), and lies between 1 and mm. Put pX=log⁡2f(2)p_X = \log_2 f(2). For r≥1r \ge1, let ℓ=⌊rlog⁡2m⌋\ell= \lfloor r \log_2 m \rfloor. Comparison with 2ℓ≤mr<2ℓ+12^\ell\le m^r < 2^{\ell+1} gives f(2)ℓ≤f(m)r≤f(2)ℓ+1f(2)^\ell\le f(m)^r \le f(2)^{\ell+1}. Taking logarithms and letting r→∞r \to\infty proves the first identity; the other two follow in the same way.

The product BX(m)BY(m)BZ(m)B_X(m)B_Y(m)B_Z(m) has variables xbcx_{bc}, yacy_{ac}, zabz_{ab} and monomials xbcyaczabx_{bc}y_{ac}z_{ab}, so it is isomorphic to TmT_m. Consequently

λ(Tm)=mpX+pY+pZ.\lambda(T_m) = m^{p_X+p_Y+p_Z}.

Setting all off-diagonal variables of TmT_m to zero leaves mm independent scalar products. Hence Tm≥mT_m \ge m, and pX+pY+pZ≥1p_X + p_Y + p_Z \ge1. In particular, the parameter t=(pX+pY+pZ)/3t = (p_X + p_Y + p_Z)/3 used below is always positive.

Degenerations and interpolation

We use only the following elementary form of degeneration. After fixed linear substitutions, give each variable an integer weight, multiply it by the corresponding power of a parameter ε\varepsilon, and retain the terms of minimum total weight. Write A⇝BA \rightsquigarrow B if this procedure takes AA to BB, with the convention 0⇝00 \rightsquigarrow0. Individual weights may be negative. Shifting the minimum total weight to zero makes the resulting tensor a polynomial in ε\varepsilon with constant coefficient BB.

Lemma 2.3 (Interpolation). If A⇝BA \rightsquigarrow B, then λ(A)≥λ(B)\lambda(A) \ge\lambda(B) for every tensor character λ\lambda.

Proof. This is the interpolation passage from approximate to exact bilinear algorithms [3], applied to characters. Let F(ε)=B+εF1+⋯+εLFLF(\varepsilon)=B+\varepsilon F_1+\cdots+\varepsilon^L F_L be the transformed tensor. For each nonzero ε\varepsilon, it is a restriction of AA. The polynomial F(ε)⊗jF(\varepsilon)^{\otimes j} has degree at most jLjL and constant coefficient B⊗jB^{\otimes j}. Interpolation at jL+1jL+1 distinct nonzero points writes this coefficient as a linear combination of specializations. A linear combination of tensors on common spaces is a restriction of their full direct sum: identify the corresponding variables and absorb each scalar coefficient into one leg. Therefore

λ(B)j≤(jL+1)λ(A)j.\lambda(B)^j \le(jL+1)\lambda(A)^j.

Taking jjth roots and letting j→∞j \to\infty proves the result. The degeneration, and hence LL, is fixed during this limit.

Separating a shared tensor leg

Suppose blocks share their first leg, while each of the other two legs determines the same block label. The following construction makes the blocks fully independent. Its auxiliary factor is retained in the output and will supply the entropy gain.

Proposition 3.1 (Finite separation). Let M≥1M \ge1 and

A=∑h=1MAh,Ah∈X⊗Yh⊗Zh,A=\sum_{h=1}^{M} A_h,\qquad A_h \in X \otimes Y_h \otimes Z_h,

where the YhY_h are disjoint coordinate spaces and so are the ZhZ_h. There are no terms between unmatched second- and third-leg sectors. Then

A⊕5M⇝⨁h=1M(Ah⊗BX(M)).(3)A^{\oplus5M} \rightsquigarrow\bigoplus_{h=1}^{M}(A_h \otimes B_X(M)). \tag*{(3)}

Each AhA_h on the right has its own copy of XX.

Proof. Choose a common first-leg basis xax_a and sector bases yh,b,zh,cy_{h,b},z_{h,c}, and write

A=∑h,a,b,cch,a,b,cxayh,bzh,c.A=\sum_{h,a,b,c}c_{h,a,b,c}x_a y_{h,b}z_{h,c}.

The internal index ranges may depend on hh. Set L=5ML=5M, and choose a primitive LLth root of unity ζ\zeta. Index the LL source copies by r=0,…,L−1r=0,\ldots,L-1. Introduce target variables Xa,gX_{a,g}, Yh,b,uY_{h,b,u}, Zh,c,vZ_{h,c,v}, where g,u,v∈{1,…,M}g,u,v \in\{1,\ldots,M\}. The index gg is a tentative sector label; u,vu,v will supply the retained dot product. Make the substitutions

xa(r)↦∑g=1Mζ2rgXa,g,x_a^{(r)} \mapsto\sum_{g=1}^{M} \zeta^{2rg}X_{a,g},
yh,b(r)↦∑u=1Mζr(u−h)Yh,b,u,y_{h,b}^{(r)} \mapsto\sum_{u=1}^{M} \zeta^{r(u-h)}Y_{h,b,u},
zh,c(r)↦1L∑v=1Mζr(−v−h)Zh,c,v.z_{h,c}^{(r)} \mapsto\frac{1}{L}\sum_{v=1}^{M}\zeta^{r(-v-h)}Z_{h,c,v}.

All copies map into the same target spaces. Summing over rr multiplies each target coefficient by

1L∑r=0L−1ζr[u−v+2(g−h)].\frac{1}{L}\sum_{r=0}^{L-1}\zeta^{r[u-v+2(g-h)]}.

This is the indicator of equality modulo LL. Since ∣u−v+2(g−h)∣≤3(M−1)<L\lvert u-v+2(g-h)\rvert\leq3(M-1)<L, precisely the terms satisfying

u−v+2(g−h)=0u-v+2(g-h)=0

survive. The phase on each leg uses only indices already present on that leg. To force the tentative label gg to equal hh, give the target variables the weights

w(Xa,g)=g2,w(Yh,b,u)=hu−h2,w(Zh,c,v)=−hv.w(X_{a,g})=g^2,\qquad w(Y_{h,b,u})=hu-h^2,\qquad w(Z_{h,c,v})=-hv.

On every surviving term, (3.2) gives

g2+hu−h2−hv=(g−h)2≥0.g^2+hu-h^2-hv=(g-h)^2\geq0.

The weight-zero tensor is therefore

D=∑h,a,b,c,uch,a,b,cXa,hYh,b,uZh,c,u.D=\sum_{h,a,b,c,u}c_{h,a,b,c}X_{a,h}Y_{h,b,u}Z_{h,c,u}.

All three variable groups distinguish hh. For each fixed hh, the remaining equality of the uu indices supplies exactly BX(M)B_X(M). Thus DD is the full direct sum in (3). The transformed tensor has degree at most (M−1)2(M-1)^2, even though some individual variable weights are negative.

The source in (3) uses 5M5M copies in total. The output has MM full direct-sum blocks, each with an MM-dimensional dot product. These are two different multiplicities: the dot-product index does not label additional full direct-sum blocks.

Corollary 3.2 (Shared-leg entropy inequality). Let T=∑i=1sTiT=\sum_{i=1}^{s}T_i be a sum of nonzero tensors with a common first space and matched, pairwise disjoint sectors on the other two legs, as in Proposition 3.1. For every tensor character λ\lambda and every probability vector q=(q1,…,qs)q=(q_1,\ldots,q_s),

λ(T)≥epXH(q)∏i=1sλ(Ti)qi,H(q)=−∑i=1sqilog⁡qi.(4)\lambda(T)\geq e^{p_XH(q)}\prod_{i=1}^{s}\lambda(T_i)^{q_i},\qquad H(q)=-\sum_{i=1}^{s}q_i\log q_i. \tag*{(4)}

Here logarithms are natural and 0log⁡0=00\log0=0.

Proof. We use the fixed-frequency counting familiar from tensor-power arguments; see, for example, [10], Appendix A of the full version. Proposition 3.1 turns the number of words of a given frequency into the entropy factor in (4). First take qq rational and let NN run through multiples of a common denominator. On the second and third legs of T⊗NT^{\otimes N}, retain only words with NqiNq_i occurrences of sector ii. Every supported term has the same sector word on these two legs. The retained tensor AA therefore has

M=N!∏i(Nqi)!M = \frac{N!}{\prod_i (Nq_i)!}

matched sectors, with the first leg still shared. Each sector is a product of the prescribed TiT_i, up to reordering factors, and hence has character value CN=∏iλ(Ti)NqiC_N = \prod_i \lambda(T_i)^{Nq_i}. Proposition 3.1 and Lemma 2.3 give

5Mλ(T)N≥5Mλ(A)≥M1+pXCN.5M\lambda(T)^N \ge5M\lambda(A) \ge M^{1+p_X}C_N.

Cancel MM and take NNth roots. Stirling’s formula gives N−1log⁡M→H(q)N^{-1}\log M \to H(q), proving (4) for rational qq. For each fixed NN, degeneration monotonicity was established first; no uniform bound on its degree as NN grows is required. Finally, λ(Ti)≥1\lambda(T_i) \ge1, so the right side of (4) is continuous on the probability simplex. Rational approximation proves the result for all qq.

Two inequalities for polynomial multiplication

We now apply the shared-leg inequality to a family with a simple rank bound. For positive integers a,ba,b, let

C(a,b)=∑i=0a−1∑j=0b−1xiyjzi+j.C(a,b)=\sum_{i=0}^{a-1}\sum_{j=0}^{b-1}x_i y_j z_{i+j}.

This is multiplication of homogeneous binary forms of degrees a−1a-1 and b−1b-1, paired with the dual of the output space. Evaluation at a+b−1a+b-1 distinct points followed by interpolation gives R(C(a,b))≤a+b−1R(C(a,b)) \le a+b-1. Its output flattening has rank a+b−1a+b-1, since every output monomial is a product of input monomials. Hence

R(C(a,b))=a+b−1.(5)R(C(a,b))=a+b-1. \tag*{(5)}

Fix a character λ\lambda, put t=(pX+pY+pZ)/3>0t=(p_X+p_Y+p_Z)/3>0, and let λπ(A)\lambda_\pi(A) denote its value after permuting the legs of AA by π∈S3\pi\in S_3. Each λπ\lambda_\pi is again a character; denote its first-leg dot-product exponent by pX(π)p_X^{(\pi)}. Each of the three original exponents occurs twice, so

∑π∈S3pX(π)=2(pX+pY+pZ)=6t.\sum_{\pi\in S_3}p_X^{(\pi)}=2(p_X+p_Y+p_Z)=6t.

Products over permuted legs are a standard balancing device in tensor-power analysis [10], Appendix A.3 of the full version. Here all six permutations make the profile insensitive to the leg exchanges used below. Define the symmetrized profile

P(a,b)=(∏π∈S3λπ(C(a,b)))1/(6t).P(a,b)=\left(\prod_{\pi\in S_3}\lambda_\pi(C(a,b))\right)^{1/(6t)}.

Interchanging the input legs permutes the factors in this product. Also C(1,b)=BX(b)C(1,b)=B_X(b). Together with (5) and (4.3), these observations give

P(a,b)=P(b,a)>0,P(1,b)=b,P(a,b)≤(a+b−1)1/t.(6)P(a,b)=P(b,a)>0,\qquad P(1,b)=b,\qquad P(a,b)\le(a+b-1)^{1/t}. \tag*{(6)}

The next two lemmas give the additional constraints that force the diagonal values of PP to grow.

A determinant filtration

We obtain neighboring input lengths by tensoring with BX(2)B_X(2), which doubles the second-input and output spaces, and retaining the multiplication induced on suitable quotient and kernel spaces. The filtration must be preserved by multiplication by every first input, so that the resulting comparison is a degeneration of the whole tensor.

Lemma 4.1 (Discrete concavity). For a≥1a \ge1 and b≥2b \ge2,

2P(a,b)≥P(a,b+1)+P(a,b−1).(7)2P(a,b) \ge P(a,b+1) + P(a,b-1). \tag*{(7)}

By symmetry, the analogous inequality holds in the first argument.

Proof. Let VeV_e be the degree-ee homogeneous forms in u,vu,v, and set W1=span⁡(s,w)W_1 = \operatorname{span}(s,w) for a second pair of variables. The tensor C(a,b)⊗BX(2)C(a,b) \otimes B_X(2) represents multiplication

Va−1×(Vb−1⊗W1)⟶Va+b−2⊗W1.V_{a-1} \times(V_{b-1} \otimes W_1) \longrightarrow V_{a+b-2} \otimes W_1.

Put D=uw−vsD = uw-vs. For e≥1e \ge1, diagonal substitution (s,w)=(u,v)(s,w)=(u,v) gives the exact sequence

0⟶DVe−1⟶Ve⊗W1⟶Ve+1⟶0.0 \longrightarrow DV_{e-1} \longrightarrow V_e \otimes W_1 \longrightarrow V_{e+1} \longrightarrow0.

The last map is surjective on monomials. Its kernel contains DVe−1DV_{e-1}; multiplication by DD is injective, and both the kernel and Ve−1V_{e-1} have dimension ee, proving exactness. This is the determinant exact sequence underlying the degree-one Clebsch–Gordan construction [9], Section 2.6 of the author version. We next check the compatibility with all multiplication maps that is needed for the tensor degeneration.

Choose quotient lifts ue−ivisu^{e-i}v^i s for 0≤i≤e0 \le i \le e, followed by vewv^e w, and append the kernel basis Due−1−jvjDu^{e-1-j}v^j for 0≤j<e0 \le j < e. Their diagonal images and their kernel factors are the standard monomial bases. Use these bases at degrees b−1b-1 and a+b−2a+b-2. For every f∈Va−1f \in V_{a-1}, multiplication commutes with diagonal substitution and sends DgDg to D(fg)D(fg). Thus every slice has the form

input quotientinput kerneloutput quotientMf+0output kernel∗Mf−(8)\begin{array}{c|cc} & \text{input quotient} & \text{input kernel} \\ \hline \text{output quotient} & M_f^+ & 0 \\ \text{output kernel} & * & M_f^- \tag*{(8)} \end{array}

in these fixed bases. Here Mf+M_f^+ is multiplication Vb⟶Va+b−1V_b \longrightarrow V_{a+b-1}, and Mf−M_f^- is multiplication Vb−2⟶Va+b−3V_{b-2} \longrightarrow V_{a+b-3}. In particular, the two diagonal tensor blocks are exactly C(a,b+1)C(a,b+1) and C(a,b−1)C(a,b-1).

Give weight zero to the first leg and to all quotient coordinates, weight −1-1 to the second-leg kernel coordinates, and weight +1+1 to the output-dual kernel coordinates. The only potentially negative block in (8) is zero. The block marked ∗* has weight +1+1 and disappears. The weight-zero tensor therefore consists of C(a,b+1)C(a,b+1) and C(a,b−1)C(a,b-1), with a common first leg and disjoint second and third legs. For example, when a=b=2a=b=2, the identity u(vw)=v2s+vDu(vw)=v^2s+vD shows that multiplication of a quotient lift can have both quotient and kernel components.

Applying degeneration monotonicity and Corollary 3.2 to these two blocks, for any probability pair q=(q+,q−)q=(q_+,q_-) we obtain

2pX(π)λπ(C(a,b))≥epX(π)H(q)λπ(C(a,b+1))q+λπ(C(a,b−1))q−.2^{p_X^{(\pi)} } \lambda_\pi(C(a,b)) \ge e^{p_X^{(\pi)} H(q)} \lambda_\pi(C(a,b+1))^{q_+}\lambda_\pi(C(a,b-1))^{q_-}.

Use the same qq for all six characters. By (4.3), multiplication and the power 1/(6t)1/(6t) yield

2P(a,b)≥eH(q)P(a,b+1)q+P(a,b−1)q−.2P(a,b) \ge e^{H(q)}P(a,b+1)^{q_+}P(a,b-1)^{q_-}.

For positive A,BA,B, the maximum of eH(q)Aq+Bq−e^{H(q)}A^{q_+}B^{q_-} is A+BA+B, attained at q=(A,B)/(A+B)q=(A,B)/(A+B). For positive q+,q−q_+,q_-, this follows from the weighted arithmetic-geometric mean inequality applied to A/q+A/q_+ and B/q−B/q_-; the boundary follows by continuity. Taking this common maximizing pair proves (7). □\square

Three sectors

Lemma 4.2 (Shifted tripling). For all positive integers a,ha,h,

P(a,3h+a−1)≥3P(a,h).(9)P(a,3h+a-1) \ge3P(a,h). \tag*{(9)}

Proof. Put B=3h+a−1B=3h+a-1. A supported term of C(a,B)C(a,B) has indices 0≤x<a0\le x<a, 0≤y<B0\le y<B, and z=x+yz=x+y. Partition the YY-indices and ZZ-indices as follows:

leftmiddleright
YY[0,h−1][0,h-1][h,2h+a−2][h,2h+a-2][2h+a−1,3h+a−2][2h+a-1,3h+a-2]
ZZ[0,h+a−2][0,h+a-2][h+a−1,2h+a−2][h+a-1,2h+a-2][2h+a−1,3h+2a−3][2h+a-1,3h+2a-3]

Table 1.

Give weight +1+1 to middle YY-coordinates, weight −1-1 to middle ZZ-coordinates, and zero to all other coordinates. A left YY-index forces a left ZZ-index, because x+y≤h+a−2x+y\le h+a-2; a right YY-index forces a right ZZ-index. Thus no supported term has negative weight. The weight-zero part consists exactly of the three matched sectors. Figure 1 shows the smallest nontrivial example.

The degeneration of $C(2,4)$, showing shaded and crossed cells

Figure 1. The degeneration of C(2,4)C(2,4), with a=2a=2, h=1h=1. A cell (y,z)(y,z) contains xix_i when z=y+iz=y+i. The three shaded blocks survive, and the two crossed terms disappear. The blocks have disjoint YY- and ZZ-coordinates but share x0,x1x_0,x_1. The middle block is C(2,1)C(2,1) with its second and third legs exchanged and its first-leg basis reversed.

Translations identify the two outer branches with C=C(a,h)C=C(a,h). The middle branch is

∑u=0a−1∑r=0h−1xa−1−uyh+u+rzh+a−1+r.\sum_{u=0}^{a-1}\sum_{r=0}^{h-1}x_{a-1-u}y_{h+u+r}z_{h+a-1+r}.

It is CC with its second and third legs exchanged and its first-leg basis reversed. The reversal identifies this individual branch; no different first-leg maps are applied to the three branches of the whole tensor.

Let σ\sigma exchange the second and third legs. The uniform probability vector on the three branches gives

λπ(C(a,B))≥3pX(π)λπ(C)2/3λπ(Cσ)1/3.\lambda_{\pi}(C(a,B))\ge3^{p_X^{(\pi)}}\lambda_{\pi}(C)^{2/3}\lambda_{\pi}(C^{\sigma})^{1/3}.

Composition with σ\sigma permutes the six leg permutations. Thus ∏πλπ(Cσ)=∏πλπ(C)\prod_{\pi}\lambda_{\pi}(C^{\sigma})=\prod_{\pi}\lambda_{\pi}(C). Multiplying the six inequalities and taking the power 1/(6t)1/(6t) proves (9).

Discrete growth and the arithmetic exponent

The tensor constructions are complete. The following lemma turns the profile’s concavity and shifted tripling into growth along the diagonal.

Lemma 5.1 (Diagonal growth). Let P:N>02→R>0P : \mathbb{N}_{>0}^{2} \to\mathbb{R}_{>0} be symmetric, with P(1,b)=bP(1,b)=b. Suppose it satisfies (7) for a≥1a \ge1, b≥2b \ge2 and (9) for a,h≥1a,h \ge1. Then P(a,a)≥a4/3P(a,a) \ge a^{4/3} for every a≥1a \ge1.

Proof. For fixed aa, concavity makes the increments Δa,h=P(a,h+1)−P(a,h)\Delta_{a,h}=P(a,h+1)-P(a,h) nonincreasing in hh. Set Da=P(a,a)D_a=P(a,a) and Ha=2Da/(3a−1)H_a=2D_a/(3a-1). Tripling with h=ah=a gives

2Da≤P(a,4a−1)−Da=∑h=a4a−2Δa,h≤(3a−1)Δa,a.2D_a \le P(a,4a-1)-D_a=\sum_{h=a}^{4a-2}\Delta_{a,h}\le(3a-1)\Delta_{a,a}.

Thus Δa,a≥Ha\Delta_{a,a}\ge H_a. For a≥2a\ge2, symmetry and concavity bound the two increments between consecutive diagonal values:

Da−Da−1=Δa−1,a−1+Δa,a−1≥Ha−1+Ha.(10)D_a-D_{a-1}=\Delta_{a-1,a-1}+\Delta_{a,a-1}\ge H_{a-1}+H_a. \tag*{(10)}

Substituting Da=(3a−1)Ha/2D_a=(3a-1)H_a/2, rearranging, and iterating from H1=1H_1=1 gives

Ha≥(1+13(a−1))Ha−1(a≥2),H_a\ge\left(1+\frac{1}{3(a-1)}\right)H_{a-1}\qquad(a\ge2),
Ha≥∏m=1a−1(1+13m)(a≥1).(11)H_a\ge\prod_{m=1}^{a-1}\left(1+\frac{1}{3m}\right)\qquad(a\ge1). \tag*{(11)}

For a=1a=1 the product is empty and equals 1. For m≥1m\ge1, the elementary inequality (1+1/(3m))3≥1+1/m(1+1/(3m))^3\ge1+1/m now gives

Ha3≥∏m=1a−1(1+13m)3≥∏m=1a−1(1+1m)=a.H_a^3\ge\prod_{m=1}^{a-1}\left(1+\frac{1}{3m}\right)^3\ge\prod_{m=1}^{a-1}\left(1+\frac{1}{m}\right)=a.

Since (3a−1)/2≥a(3a-1)/2\ge a, we conclude Da≥aHa≥a4/3D_a\ge aH_a\ge a^{4/3}.

Proof of Theorem 1.1. For every character, the profile (4.4) satisfies all hypotheses of Lemma 5.1. Combining it with (4.5) gives

a4/3≤P(a,a)≤(2a−1)1/t.a^{4/3}\le P(a,a)\le(2a-1)^{1/t}.

Letting a→∞a\to\infty forces t≤3/4t\le3/4. Equation (2.4) therefore gives λ(Td)≤d9/4\lambda(T_d)\le d^{9/4} for every character.

For each integer d≥2d\ge2, take kd=⌈dν⌉−1k_d=\lceil d^\nu\rceil-1. Then dν−1≤kd<dνd^\nu-1\le k_d<d^\nu, so Lemma 2.2 supplies a character with λ(Td)≥kd\lambda(T_d)\ge k_d. Hence

dν≤d9/4+1.d^\nu\le d^{9/4}+1.

Taking logarithms and letting d→∞d\to\infty yields ν≤9/4\nu\le9/4. The detecting character may depend on dd; the upper bound applies uniformly to every character.

To obtain an arithmetic algorithm, fix ε>0\varepsilon>0 and choose 0<δ<ε0<\delta<\varepsilon. The definition of ν\nu supplies a fixed integer u≥2u\ge2 and an exact rank decomposition of TuT_u of length r<u9/4+δr<u^{9/4+\delta}. Its bilinear identities remain valid on matrix blocks: their coefficients are central scalars, and each product has its left-input block before its right-input block. For NN a power of uu, recursive application therefore has cost

S(N)≤rS(N/u)+Cu,r(N/u)2.S(N)\le rS(N/u)+C_{u,r}(N/u)^2.

Flattening gives r≥u2r\ge u^2. Summing the recursion levels gives S(N)=O(Nlog⁡ur)S(N)=O(N^{\log_u r}) if r>u2r>u^2, and S(N)=O(N2log⁡N)S(N)=O(N^2\log N) if r=u2r=u^2. Both are Oε(N9/4+ε)O_\varepsilon(N^{9/4+\varepsilon}). Padding an arbitrary nn to the next power of uu increases its size by less than the fixed factor uu and proves the theorem.

Remark 5.2. All coefficients of the recursive algorithm are fixed once ε\varepsilon is chosen. The argument is in the complex arithmetic model. If algebraic coefficients are desired, the equations for an exact rank decomposition have rational coefficients; a complex solution therefore implies a solution over Q‾\overline{\mathbb{Q}}, by the Nullstellensatz. The finitely many resulting coefficients lie in one number field.

Existence of detecting characters

We prove Lemma 2.2 directly within the asymptotic-spectrum framework [16, 4]. A state is a normalized, additive, restriction-monotone map S→R≥0S \to\mathbb{R}_{\ge0}. Every state satisfies 0≤λ(s)≤R(s)0 \le\lambda(s) \le R(s), and λ(s)≥1\lambda(s) \ge1 for s≠0s \ne0. A character is a state that is also multiplicative.

Fix integers d≥2d \ge2 and k≥0k \ge0 with k<dνk < d^\nu. To obtain a character with λ(Td)≥k\lambda(T_d) \ge k, we will construct states satisfying the stronger family of inequalities

λ(Tds)≥kλ(s)(s∈S).(12)\lambda(T_d s) \ge k\lambda(s) \qquad(s \in S). \tag*{(12)}

This family is preserved by normalized tensor multiplication: for any nonzero zz, replacing λ(x)\lambda(x) by λ(zx)/λ(z)\lambda(zx)/\lambda(z) preserves every inequality by applying (12) to zszs. The next lemma explains why this invariance produces multiplicativity in a nonempty compact convex family of states. We will then prove that the required family is nonempty. An empty family would give tensors DD and s≠0s \ne0 with D+ks≥D+TdsD + ks \ge D + T_d s. Repeating this conversion while keeping DD fixed would contradict k<dνk < d^\nu.

Obtaining multiplicativity

Lemma A.1. Let K\mathcal{K} be a nonempty compact convex set of states in the topology of coordinatewise convergence. Suppose that, for every nonzero z∈Sz \in S, the map

(Pzλ)(x)=λ(zx)λ(z)(P_z\lambda)(x) = \frac{\lambda(zx)}{\lambda(z)}

takes K\mathcal{K} into itself. Then K\mathcal{K} contains a multiplicative state.

Proof. Since λ(z)≥1\lambda(z) \ge1, each PzP_z is continuous in the product topology. The space RS\mathbb{R}^S is Hausdorff and locally convex, so the Schauder–Tychonoff fixed-point theorem [17] applies: a continuous self-map of a nonempty compact convex subset of such a space has a fixed point. Choose a fixed point μ\mu of PzP_z and freeze c=μ(z)c = \mu(z). The subset

K′={λ∈K:λ(zx)=cλ(x) for every x∈S}\mathcal{K}' = \{\lambda\in\mathcal{K} : \lambda(zx) = c\lambda(x) \text{ for every } x \in S\}

is nonempty and compact. Because cc is fixed, its defining equations are linear in λ\lambda, so it is convex. Taking x=1x = 1 shows that λ(z)=c\lambda(z) = c throughout K′\mathcal{K}', so all its members are fixed by PzP_z. Moreover, every PwP_w with w≠0w \ne0 preserves it:

(Pwλ)(zx)=λ(zwx)λ(w)=cλ(wx)λ(w)=c(Pwλ)(x).(P_w\lambda)(zx) = \frac{\lambda(zwx)}{\lambda(w)} = c\frac{\lambda(wx)}{\lambda(w)} = c(P_w\lambda)(x).

The construction can be repeated in K′\mathcal{K}', retaining all earlier frozen equations. By induction, every finite collection of the original maps PzP_z has a common fixed point in K\mathcal{K}. Their fixed sets are closed, so compactness and the finite intersection property give a simultaneous fixed point for all nonzero zz. It satisfies λ(zx)=λ(z)λ(x)\lambda(zx) = \lambda(z)\lambda(x) for z≠0z \ne0. Additivity implies λ(0)=0\lambda(0) = 0, which handles multiplication by zero. □

Constructing the detecting state space

Proof of Lemma 2.2. For the fixed integers d,kd,k above, let K\mathcal{K} be the subset of ∏s∈S[0,R(s)]\prod_{s \in S}[0,R(s)] defined by normalization, additivity, monotonicity, and (12). These conditions are closed affine equalities and inequalities. The product is compact, so K\mathcal{K} is compact and convex. We must first show that it is nonempty. Suppose it were empty. Compactness supplies a finite inconsistent subsystem of the defining conditions. Let E⊂SE \subset S contain every coordinate appearing in this subsystem, together with 0 and 1. Adjoin λ(0)=0\lambda(0)=0, λ(1)=1\lambda(1)=1, and write each coordinate bound homogeneously as

λ(s)≥0,R(s)λ(1)−λ(s)≥0(s∈E).\lambda(s) \ge0,\qquad R(s)\lambda(1)-\lambda(s) \ge0\quad(s \in E).

The resulting finite system remains inconsistent.

Let ese_s, s∈Es \in E, be the coordinate vectors of RE\mathbb{R}^{E}. Quotient by the span of the selected additive relation vectors and e0e_0, and write uu for the image of e1e_1. Let CC be the cone generated by the images of all inequality vectors. Before taking the quotient, these vectors have the forms

eb−ea (b≥a),eTds−kes,es,R(s)e1−es.e_b-e_a\ (b \ge a),\qquad e_{T_ds}-k e_s,\qquad e_s,\qquad R(s)e_1-e_s.

The finitely generated cone CC is closed. If −u∉C-u \notin C, separation gives a linear functional LL nonnegative on CC with L(u)>0L(u)>0. Dividing by L(u)L(u) would give a normalized solution of the finite subsystem, including its bounds. This contradicts inconsistency, so −u∈C-u \in C.

All vectors and relations have integer coefficients. Membership −u∈C-u \in C is a feasible rational linear system, so there are rational nonnegative cone coefficients and rational coefficients for the relation vectors. Clearing denominators yields a positive integer mm and an identity with nonnegative integer coefficients on the inequality vectors.

Map this identity to the additive Grothendieck group of SS by sending ese_s to [s][s]. This group adjoins formal additive inverses to the commutative monoid (S,+)(S,+); in particular, all additive relation vectors map to zero. The bound vectors map to the order differences [s]−[0][s]-[0] and [R(s)]−[s][R(s)]-[s]. Direct sums combine the ordinary order differences into [y]−[x][y]-[x] with y≥xy \ge x. Distributivity combines the special differences into [Tds]−k[s][T_ds]-k[s] for one s∈Ss \in S. We obtain

−m[1]=[y]−[x]+[Tds]−k[s],y≥x.-m[1]=[y]-[x]+[T_ds]-k[s],\qquad y \ge x.

Equality in this group means equality after adding a common element of the monoid. Thus there is c∈Sc \in S with

m+y+Tds+c=x+ks+c.m+y+T_ds+c=x+ks+c.

Put D=y+cD=y+c. Using y≥xy \ge x gives the catalytic comparison

D+ks≥D+m+Tds.(13)D+ks \ge D+m+T_ds. \tag*{(13)}

Here s≠0s \ne0: otherwise D≥D+mD \ge D+m, contradicting the additivity and monotonicity of any flattening rank.

Ruling out the obstruction. The tensor DD is a fixed additive cost. Reusing (13) converts nknk copies of ss into nn copies of TdsT_ds while paying for DD only once. We show that this contradicts the definition of ν\nu. Additive iteration gives, for every integer n≥1n \ge1,

D+nks≥D+nm+nTds≥nTds.D+nks \ge D+nm+nT_ds \ge nT_ds.

Since s≥1s \ge1, we have R(D)s≥R(D)≥DR(D)s \ge R(D) \ge D. With K=nk+R(D)K=nk+R(D), it follows that

Ks≥nTds,Kjs≥njTdjs(j≥1).(14)Ks \ge nT_ds,\qquad K^j s \ge n^j T_d^j s\quad(j \ge1). \tag*{(14)}

For the induction, multiply the jjth comparison by KK, then use Ks≥nTdsKs \ge nT_ds:

Kj+1s≥njTdj(Ks)≥nj+1Tdj+1s.K^{j+1}s \ge n^jT_d^j(Ks) \ge n^{j+1}T_d^{j+1}s.

This keeps a single factor ss and requires no cancellation. Also K>0K>0, since the first right-hand side in (14) is nonzero.

We next use the njn^j scalar copies to obtain a second matrix-multiplication factor. Its matrix dimension will multiply djd^j, while the auxiliary tensor ss still occurs only once. Fix nn and δ>0\delta>0. By the definition of ν\nu, choose a fixed integer u≥2u\ge2 with R⁡(Tu)≤uν+δ\operatorname{R}(T_u)\le u^{\nu+\delta}, and set

ℓj=⌊jlog⁡unν+δ⌋,gj=uℓj.\ell_j=\left\lfloor\frac{j\log_u n}{\nu+\delta}\right\rfloor,\qquad g_j=u^{\ell_j}.

Submultiplicativity gives

R⁡(Tgj)≤R⁡(Tu)ℓj≤u(ν+δ)ℓj≤nj.\operatorname{R}(T_{g_j})\le\operatorname{R}(T_u)^{\ell_j}\le u^{(\nu+\delta)\ell_j}\le n^j.

Thus the diagonal tensor njn^j restricts to TgjT_{g_j}. Multiplying this restriction by TdjsT_{d^j}s and using s≥1s\ge1, we obtain

Kjs≥njTdjs≥Tdjgjs≥Tdjgj.K^j s\ge n^jT_{d^j}s\ge T_{d^j g_j}s\ge T_{d^j g_j}.

A direct sum of KjK^j copies of ss has rank at most KjR⁡(s)K^j\operatorname{R}(s). Therefore

R⁡(s)Kj≥R⁡(Tdjgj)≥(djgj)ν.\operatorname{R}(s)K^j\ge\operatorname{R}(T_{d^j g_j})\ge(d^j g_j)^\nu.

First let j→∞j\to\infty, keeping n,δ,un,\delta,u fixed. Since gj1/j→n1/(ν+δ)g_j^{1/j}\to n^{1/(\nu+\delta)}, taking jjth roots gives

nk+R⁡(D)≥dνnν/(ν+δ).nk+\operatorname{R}(D)\ge d^\nu n^{\nu/(\nu+\delta)}.

Next let δ↓0\delta\downarrow0 at fixed nn; the choice of uu has disappeared from the inequality. We get nk+R⁡(D)≥ndνnk+\operatorname{R}(D)\ge nd^\nu. Finally divide by nn and let n→∞n\to\infty. The catalyst DD is fixed, so k≥dνk\ge d^\nu, a contradiction. Consequently K\mathcal{K} is nonempty.

Completing the construction. For nonzero zz, the map PzP_z of Lemma A.1 preserves normalization, additivity, and monotonicity. It preserves (12), because

(Pzλ)(Tds)=λ(Tdzs)λ(z)≥kλ(zs)λ(z)=k(Pzλ)(s).(P_z\lambda)(T_ds)=\frac{\lambda(T_dzs)}{\lambda(z)}\ge k\frac{\lambda(zs)}{\lambda(z)}=k(P_z\lambda)(s).

Its coordinate bounds follow from zx≤R⁡(x)zzx\le\operatorname{R}(x)z. Lemma A.1 supplies a multiplicative state in K\mathcal{K}, hence a character. Taking s=1s=1 in (12) gives λ(Td)≥k\lambda(T_d)\ge k.

References

  1. [1]J. Alman, R. Duan, V. Vassilevska Williams, Y. Xu, Z. Xu, and R. Zhou, More asymmetry yields faster matrix multiplication, in Proc. 2025 Annual ACM-SIAM Symposium on Discrete Algorithms, SIAM, 2025, 2005–2039. doi:10.1137/1.9781611978322.63.DOI
  2. [2]J. Alman and V. Vassilevska Williams, A refined laser method and faster matrix multiplication, TheoretiCS 3 (2024), Article 21, 1–32. doi:10.46298/theoretics.24.21. Conference version in SODA 2021, 522–539.DOI
  3. [3]D. Bini, Relations between exact and approximate bilinear algorithms. Applications, Calcolo 17 (1980), 87–97. doi:10.1007/BF02575865.DOI
  4. [4]M. Christandl, P. Vrana, and J. Zuiddam, Universal points in the asymptotic spectrum of tensors, J. Amer. Math. Soc. 36 (2023), 31–79. doi:10.1090/jams/996.DOI
  5. [5]D. Coppersmith and S. Winograd, Matrix multiplication via arithmetic progressions, J. Symbolic Comput. 9 (1990), 251–280. doi:10.1016/S0747-7171(08)80013-2.DOI
  6. [6]A. M. Davie and A. J. Stothers, Improved bound for complexity of matrix multiplication, Proc. Roy. Soc. Edinburgh Sect. A 143 (2013), 351–369. doi:10.1017/S0308210511001648.DOI
  7. [7]R. Duan, H. Wu, and R. Zhou, Faster matrix multiplication via asymmetric hashing, in Proc. 64th IEEE Annual Symposium on Foundations of Computer Science, IEEE, 2023, 2129–2138. doi:10.1109/FOCS57990.2023.00130.DOI
  8. [8]E. Dupont, M. Eisenberger, B. Kozlovskii, A. Mehrabian, F. J. R. Ruiz, A. See, R. Zhou, J. Alman, V. Vassilevska Williams, and M. Balog, Improving the matrix multiplication exponent with modern optimization and AlphaEvolve, preprint, 2026. arXiv:2608.16884.arxiv.org/abs/2608.16884
  9. [9]E. Kowalski, An introduction to the representation theory of groups, Graduate Studies in Mathematics 155, American Mathematical Society, 2014. doi:10.1090/gsm/155. Author version: Representation theory, February 17, 2017, Section 2.6.DOI
  10. [10]F. Le Gall, Powers of tensors and fast matrix multiplication, in Proc. 39th International Symposium on Symbolic and Algebraic Computation, ACM, 2014, 296–303. Full version: arXiv:1401.7714v1.DOI
  11. [11]A. Schönhage, Partial and total matrix multiplication, SIAM J. Comput. 10 (1981), 434–455. doi:10.1137/0210032.DOI
  12. [12]A. J. Stothers, On the complexity of matrix multiplication, Ph.D. thesis, University of Edinburgh, 2010. hdl:1842/4734.hdl.handle.net/1842/4734
  13. [13]V. Strassen, Gaussian elimination is not optimal, Numer. Math. 13 (1969), 354–356. doi:10.1007/BF02165411.DOI
  14. [14]V. Strassen, The asymptotic spectrum of tensors and the exponent of matrix multiplication, in Proc. 27th Annual Symposium on Foundations of Computer Science, IEEE, 1986, 49–54. doi:10.1109/SFCS.1986.52.DOI
  15. [15]V. Strassen, Relative bilinear complexity and matrix multiplication, J. Reine Angew. Math. 375/376 (1987), 406–443. doi:10.1515/crll.1987.375-376.406.DOI
  16. [16]V. Strassen, The asymptotic spectrum of tensors, J. Reine Angew. Math. 384 (1988), 102–152. doi:10.1515/crll.1988.384.102.DOI
  17. [17]A. Tychonoff, Ein Fixpunktsatz, Math. Ann. 111 (1935), 767–776. doi:10.1007/BF01472256.DOI
  18. [18]V. Vassilevska Williams, Multiplying matrices faster than Coppersmith–Winograd, in Proc. 44th Annual ACM Symposium on Theory of Computing, ACM, 2012, 887–898. doi:10.1145/2213977.2214056. Expanded corrected author version: Multiplying matrices in O(n^2.373) time, July 1, 2014.DOI
  19. [19]V. Vassilevska Williams, Y. Xu, Z. Xu, and R. Zhou, New bounds for matrix multiplication: from alpha to omega, in Proc. 2024 Annual ACM-SIAM Symposium on Discrete Algorithms, SIAM, 2024, 3792–3835. doi:10.1137/1.9781611977912.134.DOI

Paper details

vlnc:W_e65zjmxy
v1 · latestHistory (1)

published ·

Usage

views · 26

downloads · 2

A view counts once per browser per day, a download each time the PDF is requested.

LicenseRef-OpenAI-public

DOI · 10.83295/hmut-cgw9

Original source

  • Mathematics

unreleased internal OpenAI model · View statement →

Looking for related papers…
Contents