Models & providersProviders

Providers

Scaleway Paris, Tensorix Frankfurt, AWS Bedrock `eu-central-1` — what each one hosts.

CleverRouter routes to three EU-resident inference providers. Every model runs in a European data centre. No US fallback, no us-east-1, no non-EU shadow routing.

At a glance

ProviderRegionStrengthsActivation
ScalewayParis (fr-par)Chat, embed, audio, Pixtral visionAlways on
TensorixFrankfurtChat, embed, fast WhisperIf TENSORIX_API_KEY set
AWS Bedrockeu-central-1Cohere embed + rerank, Amazon NovaIf AWS_BEDROCK_API_KEY set

Scaleway (Paris, FR)

OpenAI-compatible passthrough to https://api.scaleway.ai/<project-id>/v1.

EndpointNotes
ChatStreaming, tool calls, vision (Pixtral), JSON mode
Embeddingsbaai/bge-multilingual-gemma2, qwen/qwen3-embedding
Audioopenai/whisper-large-v3
RerankNot supported

Tensorix (Frankfurt, DE)

OpenAI-compatible passthrough to https://api.tensorix.ai/v1. The fast-whisper variant beats vanilla Whisper on throughput.

EndpointNotes
ChatStreaming, tool calls
Embeddingsqwen/qwen3-embedding-8b
Audiosystran/faster-whisper-large-v3
RerankNot supported

AWS Bedrock (eu-central-1)

Special case: Bearer API key (ABSK format, not SigV4) plus a custom Converse-schema mapping. Active when the gateway has AWS_BEDROCK_API_KEY set.

EndpointNotes
ChatStreaming, tool calls, vision (Anthropic, Nova)
Embeddingscohere/embed-v4
AudioNot supported
Rerankcohere/rerank-v3-5, amazon/rerank-v1

Bedrock model IDs

Bedrock model IDs always use the eu. or global. regional prefix — never us.*. CleverRouter refuses to route to non-EU Bedrock models at request validation.

EU-only invariant

EU-only routing is an architectural constraint, not a setting:

  • No US providers. No US fallback. No multi-region failover that crosses the EU border.
  • Bedrock model IDs validated against the eu.* / global.* prefix.
  • All gateway containers run in Scaleway Paris (fr-par).

See Trust → Zero data retention and GDPR & DPA for the full data-flow story including sub-processors.

How a provider is chosen per request

For models hosted by more than one provider, the gateway picks in order:

  1. Explicit pin (X-CleverRouter-Provider) — see Provider pinning.
  2. Priority sort (model_providers.priority ASC, lowest wins).
  3. Health filter — providers marked down in the last health probe are skipped (unless all are down).
  4. Disabled or deprecated mappings are ignored.

Full flow with a diagram: Routing overview.

What's coming

  • More EU regions on Bedrock — pending AWS rollout of additional Anthropic models in eu-central-1.
  • Possible OVH / Bento.AI integration when they cover models we don't already have through Scaleway or Tensorix.