pdf icon
Volume 17 (2021) Article 2 pp. 1-32
CCC 2019 Special Issue
Barriers for Fast Matrix Multiplication from Irreversibility
Received: July 5, 2019
Revised: October 5, 2020
Published: September 16, 2021
Download article from ToC site:
[PDF (342K)]    [PS (1974K)]    [PS.GZ (408K)]
[Source ZIP]
Keywords: algebraic complexity, matrix multiplication, barriers, tensors, tensor rank
ACM Classification: F.2.1
AMS Classification: 68Q17, 68Q25

Abstract: [Plain Text Version]

Determining the asymptotic algebraic complexity of matrix multiplication, succinctly represented by the matrix multiplication exponent $\omega$, is a central problem in algebraic complexity theory. The best upper bounds on $\omega$, leading to the state-of-the-art $\omega \leq 2.37..$, have been obtained via Strassen's laser method and its generalization by Coppersmith and Winograd. Recent barrier results show limitations for these and related approaches to improve the upper bound on $\omega$. We introduce a new and more general barrier, providing stronger limitations than in previous work. Concretely, we introduce the notion of irreversibility of a tensor, and we prove (in some precise sense) that any approach that uses an irreversible tensor in an intermediate step (e.g., as a starting tensor in the laser method) cannot give $\omega = 2$. In quantitative terms, we prove that the best upper bound achievable is at least twice the irreversibility of the intermediate tensor. The quantum functionals and Strassen support functionals give (so far, the best) lower bounds on irreversibility. We provide lower bounds on the irreversibility of key intermediate tensors, including the small and big Coppersmith--Winograd tensors, that improve limitations shown in previous work. Finally, we discuss barriers on the group-theoretic approach in terms of monomial irreversibility.

--------------

A conference version of this paper appeared in the Proceedings of the 34th Computational Complexity Conference, 2019.