Tensor Streaming Processor breaks 21,700 inferences per second
Published in Graphics


It just can't stop interfering

Groq, the inventor of the Tensor Streaming Processor (TSP) architecture, today announced that its processor has achieved 21,700 inferences per second (IPS) for ResNet-50 v2 inference.