HAI by HCloud vs Modal: Token Pricing, Speed & Intelligence
Full comparison of HAI by HCloud and Modal — live token pricing, latency, throughput, context window, strengths, weaknesses, and best use cases. Rates sourced from public APIs — verify before use.
HAI by HCloud
Japan-based inference — zero data retention, JPY pricing, TEE-secured Kimi K3
HAI is HCloud's LLM inference platform based in Japan, offering DeepSeek, GLM-5.3, Kimi K3, and Gemma 4 models with a zero data retention policy. Prices are in JPY per 1M tokens, tax included. The Kimi K3 (TEE) variant runs in a Trusted Execution Environment for confidential inference. Suited for Japanese enterprises and APAC workloads requiring data residency.
Modal
Managed inference API — 10 shared-endpoint models with per-token pricing
Modal Shared Endpoints serve a fixed catalog of models from Modal-managed pools. Modal manages the hardware and autoscaling, and usage is billed per token. Shared Endpoints have model-specific concurrency limits on concurrent in-flight requests. Prices are published rates from modal.com/docs/guide/supported-models.md, re-read 2026-10-31.
Key metric comparison
—
—
—
—
—
—
—
—
—
—
—
—
Live token pricing
Strengths and weaknesses
HAI by HCloud
Modal
Key differentiators
Japan-based inference with zero data retention and a TEE-secured Kimi K3 variant for confidential workloads.
Modal Shared Endpoints provide managed per-token inference on a fixed 10-model catalog with published cached-input pricing and no infrastructure to manage.
Frequently asked questions
HAI by HCloud FAQs
What is HAI by HCloud?
HAI is HCloud's LLM inference API based in Japan. It offers DeepSeek V4.1 Flash, GLM-5.3, Kimi K3 (TEE), and Gemma 4 31B with a zero data retention policy and JPY pricing. See hai.hcloud.ltd/pricing for current rates.
What is the Kimi K3 TEE variant?
The Kimi K3 (TEE) variant runs inside a Trusted Execution Environment, providing hardware-level isolation for confidential inference. This is suited for workloads where prompt and response data must not be accessible to the infrastructure operator.
Does HAI retain my data?
No. HAI operates a zero data retention policy — prompts and responses are not stored after the request completes.
Modal FAQs
What models does Modal offer on Shared Endpoints?
Modal Shared Endpoints currently serve 10 models: GLM 5.3 Flash NVFP4, DeepSeek V4.1 Flash 1017, DeepSeek V4.1 Flash, GLM 5.3 Flash, Muse Spark Open, GLM 5.3, Inkling NVFP4, Qwen3.8-Max, Qwen3.8-Max VL, and Kimi K3. Use the model table above for per-model pricing and capability details. Source: Modal's published Shared Endpoints catalog, re-read 2026-10-31.
How much does Modal charge per 1M tokens?
Modal Shared Endpoints input prices range from $0.15/1M (GLM 5.3 Flash NVFP4) to $3.00/1M (Kimi K3). All models include cached-input pricing. See the model table for full per-model rates.
Does Modal offer prompt caching?
Yes. All 10 models in the Modal Shared Endpoints catalog have published cached-input pricing, ranging from $0.005/1M (DeepSeek V4.1 Flash 1017) to $0.30/1M (Kimi K3). Depending on the model, the cached-input rate is 77.5% to 98% below the standard input rate. Source: Modal's published Shared Endpoints rates, re-read 2026-10-31.
Provider resources
HAI by HCloud — Japan-based inference — zero data retention, JPY pricing, TEE-secured Kimi K3
HAI is HCloud's LLM inference platform based in Japan, offering DeepSeek, GLM-5.3, Kimi K3, and Gemma 4 models with a zero data retention policy. Prices are in JPY per 1M tokens, tax included. The Kimi K3 (TEE) variant runs in a Trusted Execution Environment for confidential inference. Suited for Japanese enterprises and APAC workloads requiring data residency.
Japan-based inference with zero data retention and a TEE-secured Kimi K3 variant for confidential workloads.
Modal — Managed inference API — 10 shared-endpoint models with per-token pricing
Modal Shared Endpoints serve a fixed catalog of models from Modal-managed pools. Modal manages the hardware and autoscaling, and usage is billed per token. Shared Endpoints have model-specific concurrency limits on concurrent in-flight requests. Prices are published rates from modal.com/docs/guide/supported-models.md, re-read 2026-10-31.
Modal Shared Endpoints provide managed per-token inference on a fixed 10-model catalog with published cached-input pricing and no infrastructure to manage.
Key strengths compared
HAI by HCloud
- Zero data retention policy — suitable for privacy-sensitive workloads
- Japan-based infrastructure — low latency for APAC users
- TEE-secured Kimi K3 variant for confidential inference
- JPY pricing excluded from USD cross-provider comparisons
- Smaller catalog vs global inference hubs
Modal
- Managed hardware and autoscaling — no infrastructure to operate
- Published per-token rates including cached-input pricing
- OpenAI-style per-token billing across all 10 models
- Small fixed catalog of 10 models
- Model-specific concurrency limits on shared pools
Key weaknesses compared
HAI by HCloud
- JPY pricing excluded from USD cross-provider comparisons
- Smaller catalog vs global inference hubs
- Newer provider — limited third-party benchmark transparency
Modal
- Small fixed catalog of 10 models
- Model-specific concurrency limits on shared pools
- Prices are published rates re-read 2026-10-31, not continuously collected
Provider category context
HAI by HCloud is a inference api, founded in 2024. Modal is a inference api. Both are inference api providers — the comparison is primarily about pricing, model selection, and feature differentiation within the same tier.
How to choose between them
Both HAI by HCloud and Modal host open-weight models. The key differentiators are latency, throughput, and which specific model versions each provider offers. Check the speed metrics above — inference API providers often differ significantly on tokens-per-second for the same model. Pricing is typically competitive between them; availability of specific model versions (e.g., Llama 3.1 405B, DeepSeek V3) may be the deciding factor.