GPUcloud

GPU guide

Health data and AI: GPUs hosted in Canada

Updated on

Short answer

GPU Cloud rents NVIDIA GPU servers hosted in Montreal: the servers, their disks and the computations running on them stay in Canada. That settles where the data is, not the whole compliance of a project, which also depends on your organization’s measures and assessments.

What hosting in Montreal settles

  • A single region, canada-montreal: no GPU Cloud server can be launched outside Canada, even through a configuration mistake.
  • The records, medical images or notes you copy to the server are stored on its disk, in Canada, and processed by its GPU, in Canada.
  • The GPU is attached to your server only; it is not shared with other customers while your server runs.
  • What may leave Quebec: your account information (identity, billing, e-mails), as the privacy policy explains, not the content of your servers.

What hosting does not settle

Where the servers are is one part of the file, not the whole file. Depending on your province and status, other rules apply: in Quebec, the Act respecting health and social services information; in Ontario, the Personal Health Information Protection Act. Your privacy officer remains the right person for the privacy impact assessment.

  • De-identify or pseudonymize the data before copying it to the server, when the project allows it.
  • Transfer files over SSH (scp, rsync), and limit access to the server to named SSH keys.
  • You are the server’s administrator: encrypt data at rest with the tool of your choice if your policy requires it.
  • At the end of the project, delete the server and its volumes.

What a GPU is used for in health

  • An open LLM that summarizes or structures clinical notes without sending them to a third-party API: see self-host an LLM with vLLM or Ollama on a GPU.
  • Training or inference of medical imaging models (segmentation, classification) with PyTorch and CUDA.
  • Adapting a model to internal data, with LoRA or QLoRA: see the fine-tuning guide.

The GPUs to serve an LLM, with their availability

The GPUs recommended to serve an LLM with vLLM, with 1 GPU
GPUGPUs per serverServer GPU memoryOn demand, per hourAvailability
NVIDIA RTX A6000148 GB$0.67
NVIDIA L40148 GB$1.34
NVIDIA A100 PCIe180 GB$1.81
NVIDIA RTX PRO 6000196 GB$2.48
NVIDIA H100 PCIe180 GB$3.35

Prices in Canadian dollars, taxes extra, read from the catalog when the page is built. Availability is read live; a machine out of stock shows the closest equivalent machine in stock.

For an organization’s needs (several GPUs, bank transfer, questions on where data is kept), describe them on the business and research page: a person from our team answers by e-mail. The details on where data is kept are on the data sovereignty page.

Good to know before you launch

  • Billing is hourly, at the server’s hourly rate, from prepaid credit. There is no per-minute billing, and the first hour is charged when you deploy.
  • A stopped server is still billed at the full hourly rate. To pay less, hibernate it ($0.02 per hour (about $14.60 per month), disk kept) or delete it. A Spot machine cannot be hibernated: delete it when you are done.
  • The minimum top-up is CA$25.00, paid by credit card.
  • Servers and their disks stay in Canada (region canada-montreal, in Montreal). Account information (identity, billing, e-mails) may be processed outside Quebec, as the privacy policy explains.

Frequently asked questions

Does health data stay in Canada?

The servers, their disks and the computations stay in Canada, in Montreal. Your account information may be processed outside Quebec, as the privacy policy explains.

Is hosting in Canada enough to make a project compliant?

No, it settles where the data is. Compliance also depends on your organization’s assessments, agreements and measures; your privacy officer makes that assessment.

Can I use an LLM without sending data to a third-party API?

Yes. An open model served by vLLM or Ollama runs on your server, from CA$0.67/h for an RTX A6000 with 48 GB.

Is the GPU shared with other customers?

No. While your server runs, its GPU is reserved for it.

Can I encrypt data on the server?

Yes. You are the server’s administrator and you encrypt data at rest with the tool of your choice; transfers go over SSH.

Need GPUs? We’ve got you.

Launch an NVIDIA GPU server by the hour in Canada, paid in Canadian dollars by credit card, or reserve a sold-out GPU: it launches as soon as one frees up.

Other guides