Rental size
What an 8-GPU H200 server costs per hour
Answer in brief
An 8-GPU H200 server bills eight GPU-hours for every hour it is up, and at many providers it is the only way the H200 is sold.
Runcrate is our pick if you want the smallest rental stated before you commit: it lists each GPU with its own price per GPU-hour, and the table here prints its smallest rental beside it.
One server, 1,128 GB
An 8-GPU H200 server holds 1,128 GB of GPU memory across its eight cards. The cards are linked inside the machine so that one training job can use all of them. It is the standard shape for large training runs.
It is also a large machine to pay for. The eight GPUs alone can draw up to 5,600 watts, and the price reflects everything built around them.
The hourly total
Take the per-GPU price and multiply by eight. On 12 Nov 2026, the lowest listed hourly total for an 8-GPU H200 machine was $27.92. For an 8-GPU B200 machine it was $28.00.
A full day is twenty-four times that. A week is 168 times. The meter runs on all eight cards whenever the server is up.
Smaller sizes exist
The H200 is rented in several sizes. The listings behind this site include one, two, four and eight GPUs. If your job needs two cards, a 2-GPU machine at a higher per-GPU price can cost far less than a server of eight.
The table prints the smallest rental for every listing. Sort out the sizes you cannot use before you look at price.
When eight is right
Eight is right for training one model across all the cards, and for serving a model that needs more memory than a few cards hold. In those cases every option is a server of eight, and the per-GPU figures compare fairly.
Check what surrounds the GPUs: CPU cores, system memory, local disk, and the network between machines if you will use more than one.
Where Runcrate fits
Runcrate lists each GPU with its own price per GPU-hour, billed by the second on most models, and booting is never billed. For many machines at once, Runcrate runs clusters by sealed bids for a month or longer.
Questions and answers
Sources for this entry
- Runcrate: Runcrate’s official site: what the platform is, how it bills and the range of GPUs it offers. Read 12 Nov 2026.
- Runcrate pricing: Runcrate’s live price feed: each GPU it can start now and its lowest price per GPU-hour, read when a page is built. Read 12 Nov 2026.
- Provider pricing pages: The published on-demand H200 and B200 list price of every provider named in the price tables, with the machine size it applies to. Read 12 Nov 2026.
- Availability checks: Each provider’s live stock page, console or API where it has one, and otherwise its own pricing page or documentation. Read 12 Nov 2026.
- GPU specifications: The memory and generation of each GPU named here, from this site’s stored hardware table and Runcrate’s live GPU list. Read 12 Nov 2026.
Checklists are original editorial guidance. Published prices do not establish availability.
Continue this reading path
Cite this entry
H200 Prices. “What an 8-GPU H200 server costs per hour.” Content reviewed 12 Nov 2026. https://h200prices.com/topics/h200-8-gpu-server-price