Compute Comparison
Open-Source HostOpen Weights

Chutes

Open-weight model inference on TEE GPUs

Chutes (chutes.ai) is an inference platform for open-weight models. Workloads run inside Trusted Execution Environments (TEEs) on GPU hardware, with cryptographic attestation of model and input confidentiality. The API is OpenAI-compatible and pricing is per token with no minimum commitment.

Open-weight inference platform running workloads inside TEEs with cryptographic attestation.

Open-weight inferencePrivacy-sensitive workloadsServerless LLM
Chutes Models
10
Chutes Cheapest Input
$0.02
per 1M tokens
Chutes Max Throughput
—
Chutes Min Latency
—
TTFT p50
Chutes Best Intelligence
—
Chutes Vision Models
0
Chutes Strengths
  • TEE-backed inference with cryptographic attestation
  • OpenAI-compatible API
  • Serverless, per-token pricing
  • Supports open-weight models including Llama, Mistral, Qwen, and DeepSeek
Chutes Weaknesses
    Chutes Model Tiers
    frontier
    0
    advanced
    1
    efficient
    7
    budget
    2
    Chutes Capabilities
    Vision0
    Tool Use10
    Reasoning0
    Open Weights10
    Multilingual0
    RAG / Search0
    Structured Out0
    Embeddings0
    Chutes Input vs Output Pricing ($/1M tokens)
    InputOutput
    Chutes Context Window (tokens)
    Chutes Best Model by Use Case
    cost
    Mistral-Nemo-Instruct-2407
    budget$0.02/1M in
    chat
    Qwen3-32B
    efficient$0.10/1M in
    open-weights
    Qwen3-32B
    efficient$0.10/1M in
    long-context
    DeepSeek-V4-Flash-0731
    efficient$0.44/1M in
    quality
    Kimi-K3
    advanced$1.85/1M in

    Chutes Models

    Sort by:
    ← swipe to scroll →
    ModelModalityTierPriceCached /1MTTFTThroughputContextIntel.Caps
    Mistral-Nemo-Instruct-2407
    Mistral
    Chatbudget
    $0.02/ $0.10
    in / out per 1M
    EST Oct 2026
    ———131K—
    Qwen3.8-27B
    Qwen 3
    Chatbudget
    $0.04/ $1.25
    in / out per 1M
    EST Oct 2026
    ———262K—
    Qwen3-32B
    Qwen 3
    Chatefficient
    $0.10/ $0.42
    in / out per 1M
    EST Oct 2026
    ———41K—
    gemma-4-31b-turbo
    Gemma 4
    Chatefficient
    $0.12/ $0.37
    in / out per 1M
    EST Oct 2026
    ———131K—
    Qwen3.6-27B
    Qwen 3
    Chatefficient
    $0.25/ $2.00
    in / out per 1M
    EST Oct 2026
    ———262K—
    DeepSeek-V4-Flash-0731
    DeepSeek
    Chatefficient
    $0.44/ $1.32
    in / out per 1M
    EST Oct 2026
    ———1.0M—
    Kimi-K2.6
    Kimi
    Chatefficient
    $0.45/ $1.95
    in / out per 1M
    EST Oct 2026
    ———262K—
    GLM-5.1
    GLM
    Chatefficient
    $0.98/ $3.08
    in / out per 1M
    EST Oct 2026
    ———203K—
    GLM-5.2
    GLM
    Chatefficient
    $1.25/ $3.95
    in / out per 1M
    EST Oct 2026
    ———1.0M—
    Kimi-K3
    Kimi
    Chatadvanced
    $1.85/ $9.50
    in / out per 1M
    EST Oct 2026
    ———1.0M—

    Chutes — Frequently Asked Questions (FAQs)

    Chutes Reviews

    Loading reviews...

    All LLM Providers

    Full comparison table

    Chutes LLM pricing overview

    Chutes is an inference API provider that hosts open-weight and third-party large language models. Common use cases include Open-weight inference, Privacy-sensitive workloads, Serverless LLM. Headquartered in Remote, founded 2024. All models are accessible via a REST API compatible with standard OpenAI-style request formats, enabling drop-in integration with most LLM frameworks and orchestration tools.

    Chutes vs other LLM providers

    Chutes competes with OpenAI, Anthropic, Google, Groq, Together AI, Mistral, Cohere, and other inference API providers across dimensions of price, throughput, latency, context window, and model intelligence. Use the LLM provider comparison tool to see Chutes token pricing, latency, and throughput side-by-side with any other provider. The full LLM pricing table shows all providers ranked by input token cost, output token cost, and throughput in a single sortable view.

    Why choose Chutes?

    Chutes offers 10 models across 1 advanced, 7 efficient, 2 budget tiers. For teams running high-volume inference workloads, prompt caching and batch API endpoints can reduce effective input token costs by 50–90% — check the context window cost guide for a full breakdown of caching economics.

    Understanding Chutes token pricing

    Chutes charges separately for input (prompt) and output (completion) tokens, priced per 1M tokens in USD. Output tokens are typically 3–5× more expensive than input tokens due to the compute cost of autoregressive generation. The cheapest Chutes input rate is currently $0.02/1M tokens. Prices shown are sourced from Chutes's public pricing page and updated every 15 minutes. Need help estimating your spend? Read the LLM API cost calculator guide — it covers tokens, context windows, prompt caching, and batch discounts with worked examples for RAG, chat history, and document processing workloads.

    Chutes context window and model capabilities

    Context window size directly affects both capability and cost — every token in the context window is charged as an input token. Chutes's largest context window is 1.0M tokens. For RAG and document processing workloads, longer context windows enable richer retrieval but increase per-call costs proportionally. Prompt caching — where supported — stores the KV state of repeated prefixes and charges 75–90% less for cache hits, making it the most impactful cost optimization for applications with consistent system prompts or retrieved documents. See the LLM context window cost guide for a full analysis of how context length affects your API bill.

    Self-hosted vs managed inference: when Chutes makes sense

    Managed inference APIs like Chutes eliminate infrastructure overhead — no GPU provisioning, driver management, or model serving stack to maintain. The trade-off is cost at scale: a single H100 at ~$2.50/hr can serve ~500K tokens/min of Llama 3.3 70B, which at Chutes API rates would cost significantly more per token. The break-even point depends on your request volume, latency requirements, and engineering capacity. For teams processing fewer than ~10M tokens/day, managed APIs are almost always cheaper when total cost of ownership is considered. Above that threshold, self-hosted inference on rented GPU compute typically wins on unit economics. Read the cheapest GPU cloud guide for a full break-even analysis. Historical Chutes token price data is available in the LLM price history charts.

    Compare Chutes With Another LLM Provider

    Compare Chutes vs other providers

    Side-by-side token pricing, latency, throughput, and context window. View all LLM provider comparisons →