Well, there are multiple reasons, and the most important one is that T4 is designed for the neural network inference - i.e. for making predictions on the already trained neural networks (especially those that are already quantized and compressed). While...
We have a very special #GPUoftheDay#2 today - the Nvidia T4
Being released in September 2018, it's capable of just 8.1 TFLOPS - 60% of 2080Ti - while being 2.2x times more expensive (whopping $2200!). However, this GPU is extremely popular. How so?..
offering mind-blowing 1 GB VRAM in DDR2 configuration. Compared to previous generation, it was producing 25% less heat, although my friend burned two of them while playing Crysis and S.T.A.L.K.E.R. He should've bought one of the active-cooled ones probably