What are TOPS? AI PC numbers explained, and why they don't predict AI speed

AI PC spec sheets lead with one number: TOPS. A laptop “delivers 80 TOPS”; a mini PC offers “up to 126 TOPS”. It sounds like a measure of how good the computer is at AI. It is, but only for some kinds of AI work, and not for the one many buyers care about most: running a chatbot-style model on the computer itself.

What TOPS means

TOPS stands for trillions of operations per second: the peak amount of simple math a chip’s AI hardware can do. Three kinds of chips quote it:

Chip	Example	AI TOPS
NPU, a small AI engine inside the processor	Qualcomm Snapdragon X2 Elite Extreme (X2E-94)	80
NPU	AMD Ryzen AI Max+ 395	50 (126 counting processor and graphics too)
Graphics card	NVIDIA RTX 4060	242
Graphics card	NVIDIA RTX 5090	3,352

Two cautions when comparing them. Some makers quote the NPU alone and others add the processor and graphics, as AMD’s 126 “overall” TOPS does. And TOPS can be counted at different numeric precisions, so figures from different makers, or even different generations, don’t compare directly.

What common TOPS numbers mean

These are the makers’ own figures for popular laptop and mini PC chips. “Whole chip” adds the graphics and processor to the NPU, where the maker quotes it.

Chip	NPU TOPS	Whole chip, as quoted	NPU clears the Copilot+ bar?
Intel Core Ultra 7 155H (2024 laptops)	11	33	No
Intel Core Ultra 9 285K (desktop)	13	36	No
AMD Ryzen 7 8840HS (2024 laptops)	16	39	No
Apple M4	38 (Neural Engine)	Not quoted	Not applicable (Macs)
Qualcomm Snapdragon X Elite	45	Not quoted	Yes
Intel Core Ultra 7 258V	47	115	Yes
AMD Ryzen AI 9 HX 370	50	80	Yes
Intel Core Ultra X7 358H	50	Graphics rated 122 separately	Yes
AMD Ryzen AI Max+ 395	50	126	Yes
Qualcomm Snapdragon X2 Elite and Elite Extreme	80 to 85	Not quoted	Yes

So when you see a number:

• 10 to 16 TOPS: an NPU from 2023 and 2024 “AI PCs”, too slow for Copilot+ features.
• 38 to 85 TOPS: a current NPU. Above 40, it qualifies for Copilot+ features (with 16 GB of memory and 256 GB of storage).
• 80 to 130 TOPS on a laptop or mini PC: check whether it is the NPU or the whole chip. AMD’s 126 and Intel’s 115 add graphics and processor to a 50 or 47 TOPS NPU.
• Hundreds to thousands of TOPS: a graphics card, such as the RTX 4060 (242) or RTX 5090 (3,352).

AI TOPS on laptop graphics chips

Gaming and creator laptops quote the “AI TOPS” of their NVIDIA graphics chip, which is why numbers like 194, 233 and 321 turn up in laptop listings. These are NVIDIA’s own figures:

Laptop graphics chip	AI TOPS
GeForce RTX 4050 Laptop GPU	194
GeForce RTX 4060 Laptop GPU	233
GeForce RTX 4070 Laptop GPU	321
GeForce RTX 5050 Laptop GPU	440
GeForce RTX 5060 Laptop GPU	572
GeForce RTX 5070 Laptop GPU	798
GeForce RTX 5090 Laptop GPU	1,824

Don’t compare them directly with NPU figures: as noted above, TOPS can be counted at different numeric precisions. For running models locally, the graphics chip’s memory matters more: most of these have 6 to 8 GB, which limits them to small models (see what an 8 GB graphics card can run), while the RTX 5090 Laptop GPU has 24 GB.

Where TOPS matter: Windows AI features

Microsoft’s Copilot+ PC label requires an NPU that can do more than 40 TOPS. That unlocks Windows features that run on the NPU, such as improved Windows search, and it lets apps written for Windows’ AI tools use the NPU. The NPU’s advantage is efficiency: it can run AI tasks for hours without draining a laptop battery. If you want these features, check for the Copilot+ label; beyond the 40 TOPS bar, a higher NPU number rarely changes what you can do.

Where TOPS don’t matter: how fast a local model writes

When an AI model writes an answer, it produces one word-piece (a token) at a time, and for each one it reads all of its active weights from memory. The chip spends most of its time waiting for memory, not doing math. So writing speed is set by memory bandwidth, and extra TOPS go unused.

NVIDIA’s own cards show it. In published llama.cpp results for the same small model, the RTX 5090 has 2.5 times the AI TOPS of the RTX 4090 (3,352 versus 1,321) but writes only 1.4 times faster (264 versus 188 tokens per second), close to its 1.8 times more memory bandwidth. Our study of 23 chips shows the same pattern from a $369 mini PC to the RTX 5090: speed follows bandwidth.

The NPU usually doesn’t take part at all. Popular local AI apps such as LM Studio and Ollama mostly run models on the graphics chip or the processor, so a 50 or 80 TOPS NPU sits idle while they work.

Where TOPS do help: reading long prompts

Reading your prompt is different. The model processes hundreds of tokens in one pass over its weights, so the chip’s raw math power becomes the limit. That is where a graphics card’s TOPS pay off: our RTX 4060 read prompts about 20 times faster than our 12-core Ryzen 9 7900X processor on its own, while writing about 4 times faster (T0001, T0002). If you work with long documents, compute matters too.

What to look at instead

• For AI features in Windows: the Copilot+ label (an NPU above 40 TOPS). See what an AI PC is.
• For running AI models locally: memory size (which models fit) and memory bandwidth (how fast they write). See how much memory local AI needs, or check any machine in our Can it run? calculator.
• For long documents: a graphics card or a chip with strong graphics, for fast prompt reading.