Novita

Novita GPU pricing overview

Novita is a specialist GPU cloud provider headquartered in San Francisco, CA. Novita has grown into a dual-product platform: a GPU cloud for training and fine-tuning (H100 SXM, A100, RTX 4090) and a high-volume LLM inference API serving 100+ open-source models at some of the lowest per-token rates in the market. In 2025–2026 Novita expanded its model catalog to include Llama 3.1/3.2, Qwen 2.5, DeepSeek V3/R1, and Mistral variants, and introduced batch inference pricing for high-volume workloads at up to 50% discount. The GPU cloud side offers fast provisioning (typically under 3 minutes), pre-built Docker environments for PyTorch and JAX, and persistent storage volumes. A practical choice for cost-conscious teams that want both raw GPU access and a cheap inference API from one provider. Billing is Per-token (inference), On-demand / Spot (GPU cloud) with a minimum commitment of None. Available regions include US, EU, APAC. GPU instances can be provisioned on-demand, making Novita suitable for both short-duration experiments and sustained production workloads.

Novita vs other GPU providers

Novita competes with providers including Lambda Labs, CoreWeave, RunPod, Paperspace, Vast.ai, and the major hyperscalers (AWS, Google Cloud, Azure) for GPU compute workloads spanning LLM training, fine-tuning, and inference serving. Key differentiators include: Among the lowest per-token LLM inference pricing in the market; Batch inference API at up to 50% discount for high-volume workloads; 100+ open-source models including Llama 3.2, Qwen 2.5, DeepSeek R1. Use the side-by-side comparison tool above to see Novita pricing against any other provider across shared GPU models. For a broader market view, the live GPU prices table shows all 6 Novita listings alongside 91+ providers in a single sortable view.

Best use cases for Novita

Novita is best suited for: Cost-optimized LLM inference at scale, Startups needing cheap inference API + GPU training from one vendor, Batch processing workloads with high token volumes, Teams fine-tuning Llama or Qwen on a budget. Support tiers range from Community → Enterprise, making it viable for both individual researchers and enterprise teams with SLA requirements. There are currently 6 active GPU listings on Novita, covering RTX 4090, RTX 3090, A100 80GB, H100 80GB and more. H100 SXM5 instances with NVLink interconnect are commonly used for large-scale training workloads. A100 40GB and RTX 4090 instances are frequently used for fine-tuning and inference of smaller models.

Novita billing model and cost structure

Novita uses Per-token (inference), On-demand / Spot (GPU cloud) pricing. Spot (interruptible) instances are available from $0.12/hr — interruptible instances are typically lower-cost than on-demand, suitable for fault-tolerant training jobs with checkpointing. Reserved instance pricing may be available for predictable long-running workloads — check the provider's pricing page for current committed-use rates. Always compare the effective hourly rate including egress, storage, and networking costs when evaluating total cost of ownership across providers.

Choosing the right GPU on Novita

GPU selection depends on model size, precision, and whether your workload is compute-bound or memory-bandwidth-bound. For LLM training above 30B parameters, H100 80GB SXM5 instances with NVLink are the standard choice — high HBM3 bandwidth and FP16 throughput make them well-suited for large transformer workloads. For inference of 7B–13B models in FP16 or BF16, A100 40GB is a common choice on many providers. RTX 4090 instances are widely used for fine-tuning, prototyping, and quantized inference (INT4/INT8) of models up to 70B. Read the H100 vs A100 guide or the GPU benchmarks for ML guide for a full breakdown.

How Novita pricing data is collected

Prices shown are sourced from Novita's public pricing API or pricing page and refreshed every 15 minutes. On-demand rates reflect the current list price for a single GPU instance in the cheapest available region. Spot prices, where available, reflect interruptible instance rates at the time of the last snapshot. All prices are in USD per hour. Daily snapshots are kept in our history archive and visualised in the GPU price history charts — useful for identifying seasonal pricing patterns and evaluating whether current rates are above or below the 30-day average.

Evaluating managed LLM inference APIs as an alternative to self-hosted GPU compute? Compare live LLM token prices across OpenAI, Anthropic, Google, Groq, and many other providers. The cheapest GPU cloud guide covers the break-even analysis between self-hosted and managed inference at different request volumes.