Reasoning effort
reasoning_effort controls how much internal reasoning a model may use before it answers. ModelRelay exposes one provider-neutral ladder:
none → minimal → low → medium → high → xhigh → max
Leave the field empty to use the provider’s default. Model support is a subset of the ladder: a recognized value outside a matched model’s subset is rejected instead of being silently downgraded.
Supported values by model
| Provider | Models | Supported values |
|---|---|---|
| OpenAI | GPT-5.6+ | none, minimal, low, medium, high, xhigh |
| Anthropic | Claude Fable and Mythos | none, low, medium, high, xhigh, max |
| Anthropic | Claude Opus 5 and Sonnet 5 | none, low, medium, high, xhigh, max |
| Google AI Studio | Gemini 3.7 Flash | low, medium, high |
| Google AI Studio | Other Gemini 3 models | minimal, low, medium, high |
| Fireworks AI | GLM 5.2 | none, low, medium, high, max |
| Fireworks AI | Other models | none, low, medium, high |
| Meta | All models | low, medium, high |
| xAI | Grok 4.6 | none, low, medium, high, xhigh |
| xAI | Other reasoning models | none, low, medium, high |
Models without a mapped reasoning control omit the field and retain the provider default. Do not infer support from the provider alone; use the model-specific discovery response described below.
Mapping semantics
The ladder describes intent, not identical upstream parameters:
- Always-reasoning models cannot disable thinking. For Claude Fable and Mythos,
nonemaps to Anthropic effortlow; for Grok 4.6 and other xAI reasoning models, it maps to xAI effortlow. - Claude Opus 5 and Sonnet 5 map
noneto thinking disabled. - Gemini 3.7 Flash rejects both
noneandminimal;lowis its lowest supported thinking level. - Gemini
mediumforwards to the provider’s distinct medium thinking level; it is not reduced tolow. - Omitting Gemini effort leaves the choice to the model rather than pinning a hidden relay default. Request
lowexplicitly when Gemini 3.7 Flash cost and latency must stay bounded. Thinking tokens consume the output-token budget, so leave enough room for visible output. minimal,xhigh, andmaxare available only where the upstream effort ladder exposes them. They are distinct levels, not aliases for neighboring values.
Why effort matters
Reasoning affects both latency and billed output. In same-prompt production probes, GPT-5.6 Luna at none answered in about 0.7 seconds with 5 output tokens. At the provider’s default medium, equivalent runs took about 2.5–2.8 seconds and used 200–312 output tokens.
Reasoning tokens are provider-billed output tokens. Lower effort can therefore reduce latency and cost when the task does not benefit from deeper reasoning; use higher effort when the expected quality gain justifies that budget.
Discover model support
GET /api/v1/customers/me/models returns a reasoning_efforts array for each customer-visible model. Clients should validate requested values against that array instead of maintaining their own provider table. See Get Model Catalog for the response shape.
RLM subcalls
RLM subcalls default to reasoning_effort: "none" because the root loop is the reasoning layer and subcalls are bounded workers. If the selected model has no none mapping, the implicit default is omitted so the provider default is preserved; an explicit unsupported override is rejected. Set subcall_reasoning_effort only when a delegated task needs additional reasoning. See the RLM API reference and models and subcalls guide.
Validation errors
An unrecognized ladder value is rejected with HTTP 400 and an INVALID_REQUEST classification. Model-gated provider adapters use this message shape:
unsupported reasoning_effort "ultra"
A recognized value outside a matched model’s supported subset is also rejected with HTTP 400. Model-gated adapters name the model and may list its supported values:
reasoning_effort "minimal" is not supported by model claude-sonnet-5
Provider allowlists use the corresponding provider-scoped form. Google AI reports unsupported recognized values with the resolved model and supported subset, and reports an unrecognized value as invalid reasoning_effort "ultra".