Lepton AI vs SambaNova Cloud: Token Pricing, Speed & Intelligence
Full comparison of Lepton AI and SambaNova Cloud — live token pricing, latency, throughput, context window, strengths, weaknesses, and best use cases. Rates sourced from public APIs — verify before use.
Lepton AI
NVIDIA DGX Cloud Lepton — enterprise serverless inference on DGX infrastructure
Lepton AI was acquired by NVIDIA and rebranded as NVIDIA DGX Cloud Lepton in 2026. The platform now runs on NVIDIA's DGX Cloud infrastructure, offering serverless inference for popular open-weight models with enterprise-grade reliability. The OpenAI-compatible API and developer experience remain intact, now backed by NVIDIA's global DGX Cloud footprint.
SambaNova Cloud
High-throughput inference on SambaNova RDU chips — gpt-oss-120b, GLM-5.3, Llama
SambaNova Cloud runs inference on SambaNova's proprietary Reconfigurable Dataflow Unit (RDU) chips, delivering very high throughput (800+ tokens/sec on gpt-oss-120b). The catalog covers gpt-oss-120b, GLM-5.3, MiniMax-M3, DeepSeek-V3.2, Meta-Llama-3.3-70B, and Gemma 4 31B. Pricing is PAYG with prompt caching on select models.
Key metric comparison
—
—
—
—
—
—
—
—
—
—
—
—
Live token pricing
Strengths and weaknesses
Lepton AI
SambaNova Cloud
Key differentiators
The only serverless inference platform running directly on NVIDIA DGX Cloud — enterprise reliability with the latest NVIDIA hardware, no infrastructure management required.
Proprietary RDU chips deliver industry-leading throughput on open-weight models at competitive per-token rates.
Frequently asked questions
Lepton AI FAQs
What happened to Lepton AI?
Lepton AI was acquired by NVIDIA and rebranded as NVIDIA DGX Cloud Lepton in 2026. The platform now runs on NVIDIA's DGX Cloud infrastructure with the same developer-friendly API.
What models does NVIDIA DGX Cloud Lepton support?
DGX Cloud Lepton hosts Llama 3.3 70B and other popular open-weight models. The catalog is focused on widely-used production models.
Is DGX Cloud Lepton good for production workloads?
Yes. Backed by NVIDIA's DGX Cloud infrastructure, DGX Cloud Lepton offers enterprise-grade reliability and SLAs suitable for production workloads.
SambaNova Cloud FAQs
What makes SambaNova Cloud different?
SambaNova runs inference on its own Reconfigurable Dataflow Unit (RDU) chips rather than NVIDIA GPUs. This delivers very high throughput — over 800 tokens/sec on gpt-oss-120b — at competitive per-token rates.
What models does SambaNova Cloud offer?
As of October 2026: gpt-oss-120b ($0.22/$0.59), GLM-5.3 ($1.40/$4.40, cached $0.14), MiniMax-M3 ($0.60/$2.40, cached $0.06), DeepSeek-V3.2 ($3.00/$4.50), Meta-Llama-3.3-70B ($0.60/$1.20), and Gemma 4 31B ($0.38/$1.15). See cloud.sambanova.ai/plans/pricing for current rates.
Does SambaNova offer prompt caching?
Yes, on GLM-5.3 (cached input $0.14/1M vs $1.40/1M standard) and MiniMax-M3 (cached input $0.06/1M vs $0.60/1M standard).
Provider resources
Lepton AI — NVIDIA DGX Cloud Lepton — enterprise serverless inference on DGX infrastructure
Lepton AI was acquired by NVIDIA and rebranded as NVIDIA DGX Cloud Lepton in 2026. The platform now runs on NVIDIA's DGX Cloud infrastructure, offering serverless inference for popular open-weight models with enterprise-grade reliability. The OpenAI-compatible API and developer experience remain intact, now backed by NVIDIA's global DGX Cloud footprint.
The only serverless inference platform running directly on NVIDIA DGX Cloud — enterprise reliability with the latest NVIDIA hardware, no infrastructure management required.
SambaNova Cloud — High-throughput inference on SambaNova RDU chips — gpt-oss-120b, GLM-5.3, Llama
SambaNova Cloud runs inference on SambaNova's proprietary Reconfigurable Dataflow Unit (RDU) chips, delivering very high throughput (800+ tokens/sec on gpt-oss-120b). The catalog covers gpt-oss-120b, GLM-5.3, MiniMax-M3, DeepSeek-V3.2, Meta-Llama-3.3-70B, and Gemma 4 31B. Pricing is PAYG with prompt caching on select models.
Proprietary RDU chips deliver industry-leading throughput on open-weight models at competitive per-token rates.
Key strengths compared
Lepton AI
- Backed by NVIDIA DGX Cloud infrastructure
- Enterprise-grade reliability and SLAs
- Serverless — no infrastructure management
- Smaller model catalog than Together AI or Fireworks
- Pricing may be higher than budget inference providers
SambaNova Cloud
- Proprietary RDU chips deliver very high throughput — 800+ tokens/sec on gpt-oss-120b
- Competitive pricing on gpt-oss-120b ($0.22/$0.59 per 1M)
- Prompt caching on GLM-5.3 (cached input at $0.14/1M)
- Smaller model catalog vs OpenRouter or Together AI
- No proprietary frontier models — inference-only platform
Key weaknesses compared
Lepton AI
- Smaller model catalog than Together AI or Fireworks
- Pricing may be higher than budget inference providers
- No fine-tuning support
SambaNova Cloud
- Smaller model catalog vs OpenRouter or Together AI
- No proprietary frontier models — inference-only platform
- RDU architecture may behave differently from GPU inference for some workloads
Provider category context
Lepton AI is a inference api, founded in 2023. SambaNova Cloud is a inference api, founded in 2017. Both are inference api providers — the comparison is primarily about pricing, model selection, and feature differentiation within the same tier.
How to choose between them
Both Lepton AI and SambaNova Cloud host open-weight models. The key differentiators are latency, throughput, and which specific model versions each provider offers. Check the speed metrics above — inference API providers often differ significantly on tokens-per-second for the same model. Pricing is typically competitive between them; availability of specific model versions (e.g., Llama 3.1 405B, DeepSeek V3) may be the deciding factor.