TOPS
Tera (trillion) operations per second; the unit used to describe the peak performance of NPUs and AI accelerators.
// EXPLANATION
TOPS is typically quoted for low-precision (INT8) operations and is a peak figure; real performance depends on memory bandwidth, software and the precision used. TOPS values from different vendors cannot always be compared directly.
// ALSO KNOWN AS
TOPS
// RELATED TERMS
NPU (neural processing unit)A dedicated processing unit designed to accelerate neural-network computation (matrix/tensor operations) at very low energy.
GPU (graphics processing unit)A processor with thousands of small cores that performs the same operation on lots of data in parallel, used for graphics and AI computation.
QuantizationA technique that lowers memory and speed cost by storing model weights with fewer bits (for example 8 or 4 instead of 16).