This year we started to see the growth of inference to the point where we sold more T4 units for inference than we sold V100s, which we sell for training, and both were record highs,' Nvidia CEO ...

With the A100’s ability to perform inference and training workloads faster than Nvidia's T4 and V100 GPUs and within the same package, the idea is that organizations can be much more flexible ...