Back to Bigger Picture

BIGGER PICTURE Scientific discovery

Teaching AI to invent a shorter way to multiply

Many digital tasks reduce to multiplying grids of numbers. AlphaTensor searched for new recipes for that operation—and produced answers that mathematicians and programmers could verify.

AI-generated illustration: Matrix-like grids connected by a more compact computation network.
Matrix-like grids connected by a more compact computation network. Conceptual illustration; not a photograph or an exact depiction of the real project.AI-generated illustration of the idea, not a photograph of the actual people, equipment or event.
Concrete example
76 multiplications instead of 80
Example dimensions
4×5 multiplied by 5×5
Hardware experiments
10–20% faster in specified benchmarks

How the idea works

  1. Encode unfinished multiplication

    A tensor records the calculation still to reproduce.

  2. Find a shorter exact recipe

    Reinforcement learning searches combinations that reduce it to zero.

  3. Verify and time the result

    Algebraic checks and hardware benchmarks assess each algorithm.

A familiar operation with hidden possibilities

Matrix multiplication helps computers manipulate images, calculate simulations and train neural networks. The standard method is straightforward, but not always the most economical. AlphaTensor found a recipe for multiplying a 4-by-5 matrix by a 5-by-5 matrix using 76 multiplications, improving on a previously known 80-step method; the textbook approach uses 100.

Sources: [1]

Turn the remaining work into a game board

The researchers represented the calculation as a three-dimensional array of numbers. Each move removed part of the remaining computation. Reaching an all-zero board meant the proposed recipe exactly reproduced the intended multiplication. Reinforcement learning searched for short successful games, converting an enormous space of possible formulas into a problem with an unambiguous finish line.

Sources: [1]

A mathematically short recipe is not always fastest

Practical speed also depends on the processor. The team therefore fed measured hardware performance back into the search. It reported 10–20% faster multiplication in selected Nvidia V100 and TPU v2 experiments. The released repository includes a V100 benchmark script, so the result is connected to a concrete machine and test rather than a universal speed promise.

Sources: [1][2]

Publish the recipe, not only the headline

The project released discovered algorithms, verification notebooks and thousands of distinct solutions for one matrix problem. Researchers can inspect and build on them without trusting a fluent AI explanation. This is foundational research: it offers new computational building blocks, but does not demonstrate a 20% saving for an entire scientific workflow or every application.

Sources: [2]

The original sources

  1. Google DeepMindDiscovering novel algorithms with AlphaTensor
  2. Google DeepMindAlphaTensor: algorithms, verification notebooks and benchmarks

What to explore next

A chip’s floor plan can be learnedTeaching an old factory when to start warming up
Explore all 99 applications