With next-generation AI, graphics, and media acceleration capabilities, the L40S delivers up to 5X higher inference performance than the previous-generation NVIDIA A40. With breakthrough performance and 48 gigabytes (GB) of memory capacity, the L40S is the ideal platform for accelerating multimodal generative AI workloads.
NVIDIA L40S
Unparalleled AI and graphics performance for the data center.
The Most Powerful Universal GPU
Experience breakthrough multi-workload performance with the NVIDIA L40S GPU. Combining powerful AI compute with best-in-class graphics and media acceleration, the L40S GPU is built to power the next generation of data center workloads—from generative AI and large language model (LLM) inference and training to 3D graphics, rendering, and video.
Highlights
Universal Performance
Tensor Performance
1,466 TFLOPS¹
RT Core Performance
212 TFLOPS
Single-Precision Performance
91.6 TFLOPS
1 Peak rates are based on GPU boost clock.
Features
Powered by the NVIDIA Ada Lovelace Architecture
Workloads
Multi-Workload Acceleration
Generative AI
Develop new services, insights, and original content.
LLM Training and Inference
Accelerate AI training and inference workloads.
Rendering and 3D Graphics
Power high-fidelity creative workflows with NVIDIA RTX™ graphics.
NVIDIA Omniverse
Create and operate metaverse applications.
NVIDIA OVX L40S
Scalable Data Center Infrastructure for High-Performance AI and Graphics.
Performance
Breakthrough Performance
Image Generative AI
Stable Diffusion (images per minute)
Measured performance; NVIDIA L40S
Stable Diffusion v2.1, TRT 8.6.1, BS:1, FP16 | Stable Diffusion XL 1.0, TRT 8.6.1, BS:1, FP16
Large Language Model (LLM) Inference
1st Token Latency (ms)
Measured performance; NVIDIA L40S
Llama 2-7B/13B/70B, ISL=2048, OSL=128, BS=1;: FP8.
Specifications
NVIDIA L40S GPU
| FP32 | 91.6 teraFLOPS |
| TF32 Tensor Core | 366 teraFLOPS* |
| FP16 | 733 teraFLOPS* |
| FP8 | 1,466 teraFLOPS* |
| RT Core Performance | 212 teraFLOPS |
| Max Power Consumption | 350W |
|
*With Sparsity |
|