L40 vs RTX A6000: GPU cloud servers compared in Canada
L40 from $1.34/h (1 GPU), RTX A6000 from $0.67/h (1 GPU). Memory, interconnect, server sizes and hourly prices in Canadian dollars, servers hosted in Canada.
Specs and prices
| Criterion | NVIDIA L40 | NVIDIA RTX A6000 |
|---|---|---|
| Memory per GPU | 48 GB GDDR6 | 48 GB GDDR6 |
| Interconnect | PCIe Gen4 | PCIe Gen4 |
| CUDA cores | 18,176 | 10,752 |
| Tensor cores | 568 | 336 |
| Power (TDP) | 300W | 300W |
| GPUs per server | 1, 2, 4 or 8 | 1, 2, 4 or 8 |
| On-demand price | from $1.34/h (1 GPU) | from $0.67/h (1 GPU) |
| Spot price (interruptible) | $1.07/h | $0.54/h |
Public hourly prices in Canadian dollars (CAD), taxes extra. Specs as published by NVIDIA.
In short
- Both models have 48 GB GDDR6 of memory per GPU.
- The RTX A6000 starts at $0.67/h, the L40 at $1.34/h (public hourly prices, in Canadian dollars, taxes extra).
L40 use cases
- AI inference and generative AI (images, text)
- Graphics rendering and visualization
- Video transcoding and processing
RTX A6000 use cases
- Inference of small and mid-size language models (LLMs)
- 3D rendering, visualization and content creation
- Light fine-tuning (LoRA, QLoRA)
Frequently asked questions
What is the price difference between the L40 and the RTX A6000?
L40: from $1.34/h (1 GPU). RTX A6000: from $0.67/h (1 GPU). Prices in Canadian dollars, taxes extra, hourly billing with no commitment.
How many GPUs per server for the L40 and the RTX A6000?
L40: 1, 2, 4 or 8 GPUs per server. RTX A6000: 1, 2, 4 or 8 GPUs per server.
Where are these servers hosted?
Both models are hosted in a data centre in Canada (region canada-montreal), the only region offered.