GPU Memory Calculator

Calculate VRAM requirements for model training & inference

Model Configuration

Model Parameters (M)

Total parameters in millions (M)

Data Precision

Floating point precision

Batch Size

Samples per batch

Sequence Length

Input sequence length (tokens)

Mode

Training or inference

Optimizer

Optimization algorithm

Total GPU Memory Required

0 GB

Model weights: 0 GB

Activations: 0 GB

Gradients: 0 GB

Optimizer states: 0 GB

Batch data: 0 GB

Recommended GPU

L40S / H100

Training Time Estimate

100 steps: ~5 min

Assumes 100 tokens/sec throughput on modern GPU

Recommended by our team

The #1 AI writing tool for freelancers — perfect grammar in any language, instantly.