Engineering:Turing (microarchitecture)

From HandWiki
Short description: GPU microarchitecture by Nvidia

Template:Infobox GPU microarchitecture Turing is the codename for a graphics processing unit (GPU) microarchitecture developed by Nvidia. It is named after the prominent mathematician and computer scientist Alan Turing. The architecture was first introduced in August 2018 at SIGGRAPH 2018 in the workstation-oriented Quadro RTX cards,[1] and one week later at Gamescom in consumer GeForce RTX 20 series graphics cards.[2] Building on the preliminary work of its HPC-exclusive predecessor, the Turing architecture introduces the first consumer products capable of real-time ray tracing, a longstanding goal of the computer graphics industry. Key elements include dedicated artificial intelligence processors ("Tensor cores") and dedicated ray tracing processors ("RT Cores"). Turing leverages DXR, OptiX, and Vulkan for access to ray-tracing. In February 2019, Nvidia released the GeForce 16 series of GPUs, which utilizes the new Turing design but lacks the RT and Tensor cores.

Turing is manufactured using TSMC's 12 nm FinFET semiconductor fabrication process. The high-end TU102 GPU includes 18.6 billion transistors fabricated using this process.[3] Turing also uses GDDR6 memory from Samsung Electronics, and previously Micron Technology.

Details

Die shot of the TU104 GPU used in RTX 2080 cards
Die shot of the TU106 GPU used in RTX 2060 cards
Die shot of the TU116 GPU used in GTX 1660 cards

The Turing microarchitecture combines multiple types of specialized processor core, and enables an implementation of limited real-time ray tracing.[4] This is accelerated by the use of new RT (ray-tracing) cores, which are designed to process quadtrees and spherical hierarchies, and speed up collision tests with individual triangles.

Features in Turing:

  • CUDA cores (SM, Streaming Multiprocessor)
    • Compute Capability 7.5
    • traditional rasterized shaders and compute
    • concurrent execution of integer and floating point operations (inherited from Volta)
  • Ray-tracing (RT) cores
  • Tensor (AI) cores
    • artificial intelligence
    • large matrix operations
    • Deep Learning Super Sampling (DLSS)
  • Memory controller with GDDR6/HBM2 support
  • DisplayPort 1.4a with Display Stream Compression (DSC) 1.2
  • PureVideo Feature Set J hardware video decoding
  • GPU Boost 4
  • NVLink Bridge with VRAM stacking pooling memory from multiple cards
  • VirtualLink VR
  • NVENC hardware encoding

The GDDR6 memory is produced by Samsung Electronics for the Quadro RTX series.[6] The RTX 20 series initially launched with Micron memory chips, before switching to Samsung chips by November 2018.[7]

Rasterization

Nvidia reported rasterization (CUDA) performance gains for existing titles of approximately 30–50% over the previous generation.[8][9]

Ray-tracing

The ray-tracing performed by the RT cores can be used to produce reflections, refractions and shadows, replacing traditional raster techniques such as cube maps and depth maps. Instead of replacing rasterization entirely, however, the information gathered from ray-tracing can be used to augment the shading with information that is much more photo-realistic, especially in regards to off-camera action. Nvidia said the ray-tracing performance increased about 8 times over the previous consumer architecture, Pascal.

Tensor cores

Generation of the final image is further accelerated by the Tensor cores, which are used to fill in the blanks in a partially rendered image, a technique known as de-noising. The Tensor cores perform the result of deep learning to codify how to, for example, increase the resolution of images generated by a specific application or game. In the Tensor cores' primary usage, a problem to be solved is analyzed on a supercomputer, which is taught by example what results are desired, and the supercomputer determines a method to use to achieve those results, which is then done with the consumer's Tensor cores. These methods are delivered via driver updates to consumers.[8] The supercomputer uses a large number of Tensor cores itself.

Turing dies

Comparison of Turing dies
Die TU102 TU104 TU106 TU116 TU117
Die size 754 mm2 545 mm2 445 mm2 284 mm2 200 mm2
Transistors 18.6B 13.6B 10.8B 6.6B 4.7B
Transistor density 24.7 MTr/mm2 25.0 MTr/mm2 24.3 MTr/mm2 23.2 MTr/mm2 23.5 MTr/mm2
Graphics processing
clusters (GPC)
6 6 3 3 2
Streaming
multiprocessors (SM)
72 48 36 24 16
CUDA cores 4608 3072 2304 1536 1024
Texture mapping units 288 192 144 96 64
Render output units 96 64 64 48 32
Tensor cores 576 384 288 N/A
RT cores 72 48 36
L1 cache 6.75 MB 4.5 MB 3.375 MB 2.25 MB 1.5 MB
96 KB per SM
L2 cache 6 MB 4 MB 4 MB 1.5 MB 1 MB
Max TDP 280 W 250 W 185 W 125 W 75 W

Development

Main page: Nvidia RTX

Turing's development platform is called RTX. RTX ray-tracing features can be accessed using Microsoft's DXR, OptiX, as well using Vulkan extensions (the last one being also available on Linux drivers).[10] It includes access to AI-accelerated features through NGX. The Mesh Shader, Shading Rate Image functionalities are accessible using DX12, Vulkan and OpenGL extensions on Windows and Linux platforms.[11]

Windows 10 October 2018 update includes the public release of DirectX Raytracing.[12][13]

Products using Turing

  • GeForce MX series
    • GeForce MX450 (Mobile)
    • GeForce MX550 (Mobile)
  • GeForce 16 series
    • GeForce GTX 1630
    • GeForce GTX 1650 (Mobile)
    • GeForce GTX 1650
    • GeForce GTX 1650 Super
    • GeForce GTX 1650 Ti (Mobile)
    • GeForce GTX 1660
    • GeForce GTX 1660 Super
    • GeForce GTX 1660 Ti (Mobile)
    • GeForce GTX 1660 Ti
  • GeForce 20 series
    • GeForce RTX 2060 (Mobile)
    • GeForce RTX 2060
    • GeForce RTX 2060 Super
    • GeForce RTX 2070 (Mobile)
    • GeForce RTX 2070
    • GeForce RTX 2070 Super (Mobile)
    • GeForce RTX 2070 Super
    • GeForce RTX 2080 (Mobile)
    • GeForce RTX 2080
    • GeForce RTX 2080 Super (Mobile)
    • GeForce RTX 2080 Super
    • GeForce RTX 2080 Ti
    • Titan RTX
  • Nvidia Quadro
    • Quadro RTX 3000 (Mobile)
    • Quadro RTX 4000 (Mobile)
    • Quadro RTX 4000
    • Quadro RTX 5000 (Mobile)
    • Quadro RTX 5000
    • Quadro RTX 6000 (Mobile)
    • Quadro RTX 6000
    • Quadro RTX 8000
    • Quadro T1000 (Mobile)
    • Quadro T2000 (Mobile)
    • T400
    • T400 4GB
    • T500 (Mobile)
    • T600 (Mobile)
    • T600
    • T1000
    • T1000 8GB
    • T1200 (Mobile)
  • Nvidia Tesla
    • Tesla T4

See also

References

  1. Smith, Ryan (August 13, 2018). "NVIDIA Reveals Next-Gen Turing GPU Architecture: NVIDIA Doubles-Down on Ray Tracing, GDDR6, & More" (in en-US). https://www.anandtech.com/show/13214/nvidia-reveals-next-gen-turing-gpu-architecture. 
  2. Smith, Ryan (August 20, 2018). "NVIDIA Announces the GeForce RTX 20 Series: RTX 2080 Ti & 2080 on Sept. 20th, RTX 2070 in October" (in en-US). AnandTech. https://www.anandtech.com/show/13249/nvidia-announces-geforce-rtx-20-series-rtx-2080-ti-2080-2070. 
  3. Cite error: Invalid <ref> tag; no text was provided for refs named TuringWhitepaper
  4. Warren, Tom (August 20, 2018). "Nvidia announces RTX 2000 GPU series with '6 times more performance' and ray-tracing" (in en-US). The Verge. https://www.theverge.com/2018/8/20/17758724/nvidia-geforce-rtx-2080-specs-pricing-release-date-features. 
  5. Oh, Nate (September 14, 2018). "The NVIDIA Turing GPU Architecture Deep Dive: Prelude to GeForce RTX" (in en-US). https://www.anandtech.com/show/13282/nvidia-turing-architecture-deep-dive/. 
  6. Mujtaba, Hassan (August 14, 2018). "Samsung GDDR6 Memory Powers NVIDIA's Turing GPU Based Quadro RTX Cards" (in en-US). Wccftech. https://wccftech.com/nvidia-quadro-rtx-turing-gpu-samsung-gddr6-memory/. 
  7. Maislinger, Florian (November 21, 2018). "Faulty RTX 2080 Ti: Nvidia switches from Micron to Samsung for GDDR6 memory". PC Builder's Club. https://www.pcbuildersclub.com/en/2018/11/faulty-rtx-2080-ti-nvidia-switches-from-micron-to-samsung-for-gddr6-memory/. 
  8. 8.0 8.1 "#BeForTheGame" (in en-US). https://www.twitch.tv/videos/299680425. 
  9. Fisher, Jeff (August 20, 2018). "GeForce RTX Propels PC Gaming's Golden Age with Real-Time Ray Tracing" (in en-US). https://blogs.nvidia.com/blog/2018/08/20/geforce-rtx-real-time-ray-tracing/. 
  10. "NVIDIA RTX platform" (in en-US). July 20, 2018. https://developer.nvidia.com/rtx. 
  11. "Turing Extensions for Vulkan and OpenGL" (in en-US). September 11, 2018. https://developer.nvidia.com/vulkan-turing. 
  12. Pelletier, Sean (October 2, 2018). "Windows 10 October 2018 Update a Catalyst for Ray-Traced Games" (in en-US). https://blogs.nvidia.com/blog/2018/10/02/real-time-ray-tracing-rtx-windows-10-october-update/. 
  13. van Rhyn, Jacques (October 2, 2018). "DirectX Raytracing and the Windows 10 October 2018 Update" (in en-US). https://blogs.msdn.microsoft.com/directx/2018/10/02/directx-raytracing-and-the-windows-10-october-2018-update/. 

External links