---
title: "Cloud GPUs for LLM Training — H100/H200/B200 from $0.840/hr | LowCostGPU"
description: "Train LLMs on HBM GPUs with NVLink and InfiniBand: H100 SXM at $1.680/hr fixed, $0.840/hr interruptible. Checkpoint patterns, cluster pods, real cost math."
url: https://lowcostgpu.com/use-cases/llm-training
last_modified: 2026-10-20T10:29:15+00:00
prices_as_of: 2026-10-19
site: LowCostGPU (lowcostgpu.com)
---

Use case · LLM training

# LLM training on cloud GPUs: the same silicon, no auction

Pre-training and continued pre-training live on HBM parts: H100 SXM at **$1.680** /GPU-hr fixed (market median $2.40), NVLink in-node, InfiniBand across nodes, and interruptible capacity at half price for every checkpointed epoch.

## The training cards, ranked

Full comparison in the [H100 vs H200 vs B200 guide](https://lowcostgpu.com/guides/h100-vs-h200-vs-b200).

| Tier | GPU | VRAM | On-demand | Interruptible | Why this card |  |
| --- | --- | --- | --- | --- | --- | --- |
| (Good) | [A100 SXM4](https://lowcostgpu.com/gpu/a100-sxm4) | 80 GB | $0.468 | $0.234 | Proven 80 GB HBM2e workhorse — unbeatable $/step for ≤13B experiments and LoRA-heavy labs. | [Deploy](https://cloud.lowcostgpu.com/?gpu=a100-sxm4) |
| (Better) | [H100 SXM](https://lowcostgpu.com/gpu/h100-sxm) | 80 GB | $1.680 | $0.840 | The default: FP8 transformer engine, 3.35 TB/s, deep supply in every major region. | [Deploy](https://cloud.lowcostgpu.com/?gpu=h100-sxm) |
| (Best) | [B200](https://lowcostgpu.com/gpu/b200) | 192 GB | $6.475 | $3.237 | 192 GB HBM3e and Blackwell FP4/FP8 — shortest wall-clock when the deadline is the budget. | [Deploy](https://cloud.lowcostgpu.com/?gpu=b200) |

## Cost of a real run, line by line

Continued pre-training, 8× H100 SXM, 72 hours, interruptible with volume checkpoints:

- **GPU time**: 8 × 72 h × $0.840 · **=**: $483.84
- **Checkpoint volume 500 GB**: 3 days × $40.00/mo · **=**: $4.00
- **Dataset ingress 400 GB**: 400 × $0.01 · **=**: $4.00
- **Total**:  · **≈**: **$492**

The market-median equivalent of the GPU line alone: about $691 at spot auctions you have to babysit — or $1,382 on-demand.

## Patterns that make it cheap

- **Checkpoint to a volume** every N steps — interruptions restart free, from disk.
- **Tune on 1×, train on 8×** — debug the config at one-eighth the burn rate.
- **Pack with FP8/BF16** — the H100/H200 transformer engine is the discount nobody uses.
- **Destroy, keep the volume** — datasets stay warm at $0.08/GB/mo, GPUs bill zero.

Templates: [PyTorch, axolotl](https://lowcostgpu.com/templates) (FSDP-ready) — or your own image with [a full VM](https://lowcostgpu.com/products/vms) for exotic stacks.

## LLM training GPUs: FAQ

Sizing math: [VRAM requirements guide](https://lowcostgpu.com/guides/llm-vram-requirements).

**Which GPU should I train an LLM on?**

For serious runs: H100 SXM ($1.680/hr) is the price-performance default, H200 adds 141 GB for longer context and bigger micro-batches, B200 leads when wall-clock time is the constraint. For sub-13B experiments, 8× A100 nodes at $0.468/GPU-hr are hard to beat.

**On-demand or interruptible for training?**

Interruptible, almost always — training checkpoints anyway, and −50% compounds over hundreds of GPU-hours. A 72-hour run on 8× H100 costs about $484 interruptible vs $968 on-demand. Keep on-demand for the final, deadline-bound run.

**How do multi-node runs connect?**

Single machines scale to 8× with NVLink. Past that, clusters connect 8-GPU nodes over InfiniBand with NCCL pre-tuned — see the clusters page for pod pricing and all-reduce figures.

---

*About LowCostGPU:* LowCostGPU (lowcostgpu.com) is a cloud GPU rental service offering 83 NVIDIA GPU models — from the Tesla P4 at $0.019/hr to the B300 — at fixed prices set at least 30% below the public GPU marketplace median and re-checked weekly (H100 SXM: $1.680/hr on-demand). Billing is per second with no minimums; payment is crypto only (USDT, BTC, XMR, ETH, SOL, LTC, TRX) with no KYC. Instances run in Tier-III datacenters across 32 regions with a 99.9% uptime SLA and deploy in about 30 seconds from the web console (cloud.lowcostgpu.com) or the REST API.

Source: https://lowcostgpu.com/use-cases/llm-training · Site index for AI assistants: https://lowcostgpu.com/llms.txt · Full content: https://lowcostgpu.com/llms-full.txt