CloudGPU vs Modal: Token Pricing, Speed & Intelligence
Full comparison of CloudGPU and Modal — live token pricing, latency, throughput, context window, strengths, weaknesses, and best use cases. Rates sourced from public APIs — verify before use.
CloudGPU
API gateway / reseller — 33 text models at CloudGPU customer rates
CloudGPU is an API gateway and reseller offering access to frontier and mid-tier text models including Claude, GPT, Kimi, GLM, Qwen, DeepSeek, and MiniMax. Prices shown are CloudGPU customer rates — not official lab prices. CloudGPU does not disclose all routing; upstreams are not the seller.
Modal
Managed inference API — 10 shared-endpoint models with per-token pricing
Modal Shared Endpoints serve a fixed catalog of models from Modal-managed pools. Modal manages the hardware and autoscaling, and usage is billed per token. Shared Endpoints have model-specific concurrency limits on concurrent in-flight requests. Prices are published rates from modal.com/docs/guide/supported-models.md, re-read 2026-10-31.
Key metric comparison
—
—
—
—
—
—
—
—
—
—
—
—
Live token pricing
Strengths and weaknesses
CloudGPU
Modal
Key differentiators
An API gateway offering CloudGPU customer rates on 33 text models — prices differ from official lab rates; routing is not fully disclosed.
Modal Shared Endpoints provide managed per-token inference on a fixed 10-model catalog with published cached-input pricing and no infrastructure to manage.
Frequently asked questions
CloudGPU FAQs
Are CloudGPU prices the same as official provider prices?
No. CloudGPU is an API gateway/reseller. The prices shown are CloudGPU customer rates, which may differ from official lab prices. CloudGPU does not disclose all routing details.
What models does CloudGPU offer?
CloudGPU offers 33 text models including Claude Fable 5.1, Claude Opus 5-5, Kimi K3, GLM-5.3, Qwen 3.8 Max, DeepSeek V4 Pro, GPT-6 Astra, and MiniMax M3. See the model table for current rates.
What is the CloudGPU API base URL?
The CloudGPU API base is https://cloudgpu.app/v1 with OpenAI-compatible endpoints. See https://cloudgpu.app/api/docs for full documentation.
Modal FAQs
What models does Modal offer on Shared Endpoints?
Modal Shared Endpoints currently serve 10 models: GLM 5.3 Flash NVFP4, DeepSeek V4.1 Flash 1017, DeepSeek V4.1 Flash, GLM 5.3 Flash, Muse Spark Open, GLM 5.3, Inkling NVFP4, Qwen3.8-Max, Qwen3.8-Max VL, and Kimi K3. Use the model table above for per-model pricing and capability details. Source: Modal's published Shared Endpoints catalog, re-read 2026-10-31.
How much does Modal charge per 1M tokens?
Modal Shared Endpoints input prices range from $0.15/1M (GLM 5.3 Flash NVFP4) to $3.00/1M (Kimi K3). All models include cached-input pricing. See the model table for full per-model rates.
Does Modal offer prompt caching?
Yes. All 10 models in the Modal Shared Endpoints catalog have published cached-input pricing, ranging from $0.005/1M (DeepSeek V4.1 Flash 1017) to $0.30/1M (Kimi K3). Depending on the model, the cached-input rate is 77.5% to 98% below the standard input rate. Source: Modal's published Shared Endpoints rates, re-read 2026-10-31.
Provider resources
CloudGPU — API gateway / reseller — 33 text models at CloudGPU customer rates
CloudGPU is an API gateway and reseller offering access to frontier and mid-tier text models including Claude, GPT, Kimi, GLM, Qwen, DeepSeek, and MiniMax. Prices shown are CloudGPU customer rates — not official lab prices. CloudGPU does not disclose all routing; upstreams are not the seller.
An API gateway offering CloudGPU customer rates on 33 text models — prices differ from official lab rates; routing is not fully disclosed.
Modal — Managed inference API — 10 shared-endpoint models with per-token pricing
Modal Shared Endpoints serve a fixed catalog of models from Modal-managed pools. Modal manages the hardware and autoscaling, and usage is billed per token. Shared Endpoints have model-specific concurrency limits on concurrent in-flight requests. Prices are published rates from modal.com/docs/guide/supported-models.md, re-read 2026-10-31.
Modal Shared Endpoints provide managed per-token inference on a fixed 10-model catalog with published cached-input pricing and no infrastructure to manage.
Key strengths compared
CloudGPU
- Access to frontier models including Claude Fable 5.1, Kimi K3, and GPT-6 Astra
- Competitive customer rates on Chinese frontier models (GLM, Kimi, Qwen, MiniMax)
- OpenAI-compatible API base at cloudgpu.app/v1
- API gateway/reseller — routing not fully disclosed
- Prices are CloudGPU customer rates, not official lab prices
Modal
- Managed hardware and autoscaling — no infrastructure to operate
- Published per-token rates including cached-input pricing
- OpenAI-style per-token billing across all 10 models
- Small fixed catalog of 10 models
- Model-specific concurrency limits on shared pools
Key weaknesses compared
CloudGPU
- API gateway/reseller — routing not fully disclosed
- Prices are CloudGPU customer rates, not official lab prices
- Per-model context window and capability facts are not publicly documented
Modal
- Small fixed catalog of 10 models
- Model-specific concurrency limits on shared pools
- Prices are published rates re-read 2026-10-31, not continuously collected
Provider category context
CloudGPU is a inference api. Modal is a inference api. Both are inference api providers — the comparison is primarily about pricing, model selection, and feature differentiation within the same tier.
How to choose between them
Both CloudGPU and Modal host open-weight models. The key differentiators are latency, throughput, and which specific model versions each provider offers. Check the speed metrics above — inference API providers often differ significantly on tokens-per-second for the same model. Pricing is typically competitive between them; availability of specific model versions (e.g., Llama 3.1 405B, DeepSeek V3) may be the deciding factor.