NVIDIA H200 GPU servers are now available for order.  Learn more
Does Not Have Feature
Borealis L40S Servers

NVIDIA L40S PCIe GPU Servers

The most powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications.

8x L40S PCIe GPU Server

NVIDIA L40S 4U Servers

GPU
8x L40S 48GB PCIe
CPU
2x Intel or AMD processors
Memory
Up to 2.3TB DDR5
Starting at
$119,000

NVIDIA L40S PCIe GPU

Experience breakthrough multi-workload performance with the NVIDIA L40S GPU. Combining powerful AI compute with best-in-class graphics and media acceleration, the L40S GPU is built to power the next generation of data center workloads. With shorter lead times than the H100, this GPU is ideal for inference workloads.

Primary Use Cases

HPC
High Performance Computing

Unprecedented computational power for scientific research and simulations with large datasets and intricate calculations.

DL Inference
Deep Learning Inference

Harness the power of efficient neural network processing to enable swift and accurate predictions.

Graphic Rendering
Graphics & Rendering

Powering immersive gaming environments, architectural visualizations, and cinematic renderings.

Media Processing
Media Processing

From video transcoding to image manipulation, ensure efficient and rapid processing for content creation and distribution.

GPU Specifications

NVIDIA L40S PCIeSpecifications
GPU ArchitectureNVIDIA Ada Lovelace Architecture
FP64 TFLOPSN/A
FP64 Tensor Core TFLOPSN/A
FP32 TFLOPS91.6
TF32 Tensor Core TFLOPS183 | 366*
BFLOAT16 Tensor Core TFLOPS362.05 | 733*
FP16 Tensor Core362.05 | 733*
FP8 Tensor Core733 | 1,466*
INT8 Tensor Core733 | 1,466* TOPS
GPU memory48GB GDDR6 with ECC
GPU memory bandwidth864GB/s
Decoders3 NVENC | 3 NVDEC
Max thermal design power (TDP)350W
Multi-Instance GPUsNo
Form factorPCIe dual-slot air-cooled
NVLink SupportNo
*With SparsityView Full Specs