GPU guide
Health data and AI: GPUs hosted in Canada
Updated on
Short answer
GPU Cloud rents NVIDIA GPU servers hosted in Montreal: the servers, their disks and the computations running on them stay in Canada. That settles where the data is, not the whole compliance of a project, which also depends on your organization’s measures and assessments.
What hosting in Montreal settles
- A single region, canada-montreal: no GPU Cloud server can be launched outside Canada, even through a configuration mistake.
- The records, medical images or notes you copy to the server are stored on its disk, in Canada, and processed by its GPU, in Canada.
- The GPU is attached to your server only; it is not shared with other customers while your server runs.
- What may leave Quebec: your account information (identity, billing, e-mails), as the privacy policy explains, not the content of your servers.
What hosting does not settle
Where the servers are is one part of the file, not the whole file. Depending on your province and status, other rules apply: in Quebec, the Act respecting health and social services information; in Ontario, the Personal Health Information Protection Act. Your privacy officer remains the right person for the privacy impact assessment.
- De-identify or pseudonymize the data before copying it to the server, when the project allows it.
- Transfer files over SSH (
scp,rsync), and limit access to the server to named SSH keys. - You are the server’s administrator: encrypt data at rest with the tool of your choice if your policy requires it.
- At the end of the project, delete the server and its volumes.
What a GPU is used for in health
- An open LLM that summarizes or structures clinical notes without sending them to a third-party API: see self-host an LLM with vLLM or Ollama on a GPU.
- Training or inference of medical imaging models (segmentation, classification) with PyTorch and CUDA.
- Adapting a model to internal data, with LoRA or QLoRA: see the fine-tuning guide.
The GPUs to serve an LLM, with their availability
| GPU | GPUs per server | Server GPU memory | On demand, per hour | Availability |
|---|---|---|---|---|
| NVIDIA RTX A6000 | 1 | 48 GB | $0.67 | |
| NVIDIA L40 | 1 | 48 GB | $1.34 | |
| NVIDIA A100 PCIe | 1 | 80 GB | $1.81 | |
| NVIDIA RTX PRO 6000 | 1 | 96 GB | $2.48 | |
| NVIDIA H100 PCIe | 1 | 80 GB | $3.35 |
Prices in Canadian dollars, taxes extra, read from the catalog when the page is built. Availability is read live; a machine out of stock shows the closest equivalent machine in stock.
For an organization’s needs (several GPUs, bank transfer, questions on where data is kept), describe them on the business and research page: a person from our team answers by e-mail. The details on where data is kept are on the data sovereignty page.
Good to know before you launch
- Billing is hourly, at the server’s hourly rate, from prepaid credit. There is no per-minute billing, and the first hour is charged when you deploy.
- A stopped server is still billed at the full hourly rate. To pay less, hibernate it ($0.02 per hour (about $14.60 per month), disk kept) or delete it. A Spot machine cannot be hibernated: delete it when you are done.
- The minimum top-up is CA$25.00, paid by credit card.
- Servers and their disks stay in Canada (region canada-montreal, in Montreal). Account information (identity, billing, e-mails) may be processed outside Quebec, as the privacy policy explains.
Frequently asked questions
Does health data stay in Canada?
The servers, their disks and the computations stay in Canada, in Montreal. Your account information may be processed outside Quebec, as the privacy policy explains.
Is hosting in Canada enough to make a project compliant?
No, it settles where the data is. Compliance also depends on your organization’s assessments, agreements and measures; your privacy officer makes that assessment.
Can I use an LLM without sending data to a third-party API?
Yes. An open model served by vLLM or Ollama runs on your server, from CA$0.67/h for an RTX A6000 with 48 GB.
Is the GPU shared with other customers?
No. While your server runs, its GPU is reserved for it.
Can I encrypt data on the server?
Yes. You are the server’s administrator and you encrypt data at rest with the tool of your choice; transfers go over SSH.
Need GPUs? We’ve got you.
Launch an NVIDIA GPU server by the hour in Canada, paid in Canadian dollars by credit card, or reserve a sold-out GPU: it launches as soon as one frees up.
Other guides
- Your AI says you need a GPU? Run your Python script on a GPU in minutes
- CUDA out of memory: causes, fixes, and when to move to a GPU with more VRAM
- torch.cuda.is_available() returns False: causes and fixes (Mac, PC without NVIDIA, Docker)
- How much does a GPU cost per hour in Canada, in Canadian dollars?
- OpenAI API too expensive? Host your LLM on a GPU by the hour, in Canada
- Rent a GPU by the hour in Canada: prices, steps and billing
- GPU cloud in Montreal, Canada: NVIDIA GPU servers hosted in the country
- Rent an H100 in Canada: PCIe, NVLink or SXM, by the hour
- Which GPU to fine-tune an LLM? Memory, machine and cost
- Cheap GPU cloud: how to pay as little as possible for a GPU
- Ollama on a cloud GPU: run an LLM online on your own server
- GPU for Stable Diffusion and ComfyUI: generate images on a rented server
- Rent an 8-GPU server: 8x H100 or 8x A100 NVLink, by the hour
- RunPod alternative in Canada: GPUs by the hour, in Canadian dollars
- GPU for university research in Quebec: rent a GPU by the hour