RTX PRO 6000 vs L40: GPU cloud servers compared in Canada
RTX PRO 6000 from $2.48/h (1 GPU), L40 from $1.34/h (1 GPU). Memory, interconnect, server sizes and hourly prices in Canadian dollars, servers hosted in Canada.
Specs and prices
| Criterion | NVIDIA RTX PRO 6000 | NVIDIA L40 |
|---|---|---|
| Memory per GPU | 96 GB GDDR7 | 48 GB GDDR6 |
| Interconnect | PCIe Gen5 | PCIe Gen4 |
| CUDA cores | 24,064 | 18,176 |
| Tensor cores | 752 | 568 |
| Power (TDP) | 600W | 300W |
| GPUs per server | 1, 2, 4 or 8 | 1, 2, 4 or 8 |
| On-demand price | from $2.48/h (1 GPU) | from $1.34/h (1 GPU) |
| Spot price (interruptible) | $1.98/h | $1.07/h |
Public hourly prices in Canadian dollars (CAD), taxes extra. Specs as published by NVIDIA.
In short
- The RTX PRO 6000 has 96 GB GDDR7 per GPU, against 48 GB GDDR6 for the L40: a key criterion for the size of the models held in memory.
- The L40 starts at $1.34/h, the RTX PRO 6000 at $2.48/h (public hourly prices, in Canadian dollars, taxes extra).
RTX PRO 6000 use cases
- LLM inference with 96 GB of memory per GPU
- 3D rendering, simulation, CAD/CAM
- Generative AI (images, video)
L40 use cases
- AI inference and generative AI (images, text)
- Graphics rendering and visualization
- Video transcoding and processing
Frequently asked questions
What is the price difference between the RTX PRO 6000 and the L40?
RTX PRO 6000: from $2.48/h (1 GPU). L40: from $1.34/h (1 GPU). Prices in Canadian dollars, taxes extra, hourly billing with no commitment.
How many GPUs per server for the RTX PRO 6000 and the L40?
RTX PRO 6000: 1, 2, 4 or 8 GPUs per server. L40: 1, 2, 4 or 8 GPUs per server.
Where are these servers hosted?
Both models are hosted in a data centre in Canada (region canada-montreal), the only region offered.