Choose OmniSwitch when…
- Self-hosted policy and gateway ownership are your primary requirements.
- You can re-map your logging and observability contract.
- You want a local gateway with an explicitly bounded beta scope.
Architecture before checklists
OmniSwitch vs Helicone
Compare a secure self-hosted control plane, AI gateway routing, and agent protocol scope with Helicone. Evaluate the operating model before the feature list.
Updated · Public beta
OSS gateway; maintenance context. Register a8a594b; each cell records its own version and verified date. A capability review, not a benchmark.
At a glance
Choose Helicone when…
- Your current observability workflow meets your needs.
- You have evaluated the live service and maintenance commitment.
- Avoiding a migration is more important than changing the gateway operating model.
No scores or totals: uneven documentation coverage is not a measure of product quality.
The full capability comparison
READING THE MATRIXSupportedManaged onlyPartialNot availableNot verified
| Capability | OmniSwitch[1]Register a8a594b | Helicone[4]OSS gateway; maintenance context | Managed platformSeparate registered edition |
|---|---|---|---|
| Deployment & license | |||
| Self-hosted deployment | Not verifiedNo claim is recorded for this capability in the pinned register.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedNo claim is recorded for this capability in the pinned register.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedNo claim is recorded for this capability in the pinned register.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| SQLite / Postgres storage | SupportedSQLite by default; PostgreSQL via OMNISWITCH_DATABASE_URL. Logs and keys remain SQLite-local even in the Postgres case per the project's own docs.
| Not availableDocumented cache/rate-limit backends are Redis and S3, not SQLite/Postgres.
| Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Kubernetes manifests / Helm chart | SupportedKustomize manifests (Deployment/Service/ConfigMap/Secret example/PVCs/Redis) plus a Helm chart; no operator/CRDs/inference-aware routing.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Config hot reload | SupportedConfig hot reload covers routes, guardrails, cache posture, circuit breaker, and shadow provider without restart.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Built-in dashboard/UI | SupportedLocal dashboard for logs, metrics, prompts, providers, and guardrails.
| Not verifiedHelicone's broader product has a hosted dashboard; a bundled dashboard inside the self-hosted AI Gateway container is not confirmed.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Managed onlyHosted observability dashboard is Helicone's core product.
|
| License | Supported | SupportedGPL-3.0 (verified via the repository's GitHub license metadata; some third-party articles incorrectly state Apache-2.0/MIT).
| Not availableClosed managed service (distinct from the GPL-3.0 self-hosted AI Gateway).
|
| APIs & providers | |||
| OpenAI-compatible chat completions | Supported/v1/chat/completions, streaming and non-streaming.
| SupportedSingle OpenAI-compatible endpoint routing 100+ models/providers.
| Managed onlyHosted proxy/observability across 100+ models.
|
| OpenAI-compatible embeddings | Supported | Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| OpenAI Responses API | Partial/v1/responses text subset only (no image/audio/tool-streaming parity with OpenAI).
/v1/responses text subset only (no image/audio/tool-streaming parity with OpenAI). | Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Anthropic Messages API | Partial/v1/messages core subset. | Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Native (non-passthrough) provider adapters | Partial4 native adapters (OpenAI, Anthropic, Google, Groq); no native Bedrock/Vertex/Cohere. Everything else goes through the generic OpenAI-compatible custom adapter with 15+ documented presets.
4 native adapters (OpenAI, Anthropic, Google, Groq); no native Bedrock/Vertex/Cohere. Everything else goes through the generic OpenAI-compatible custom adapter with 15+ documented presets. | Supported100+ providers/models claimed.
| Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Custom/generic OpenAI-compatible endpoint | SupportedGeneric custom provider adapter with presets for Azure OpenAI, Ollama, vLLM, LiteLLM, DeepSeek, Together, Fireworks, and aliases.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Routing, reliability & cost | |||
| Routing & fallbacks | Supportedroute-level fallbacks, max_retries, retry_backoff, retry_codes, per-attempt timeout.
| SupportedFailover documented as a core feature.
| Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Weighted / load-balanced routing | SupportedWeighted variants per route.
| SupportedLoad balancing documented as a core feature.
| Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Conditional routing (rule/expression based) | SupportedCEL condition expressions on route variants.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Circuit breaker | SupportedDefault 5 failures / 60s cooldown, configurable via gateway.circuit_breaker_failures / _cooldown.
| Not verifiedHealth/rate-limit-aware routing documented; a distinct circuit-breaker feature not confirmed.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Exact-match cache | SupportedSHA-256 request-fingerprint cache key, tenant-scoped (api_key/workspace/organization/global), SQLite-backed.
| SupportedResponse caching (Redis/S3 backends) documented.
| Managed only |
| Similarity cache (see scope) | SupportedNOT embedding-based. Vectorize() builds a normalized token-frequency map over lowercased, stop-word-filtered tokens; Similarity() is cosine over those token-frequency vectors. State this precisely wherever OmniSwitch's cache is compared to embedding-based semantic caches.
| Not verified"Intelligent caching" is mentioned in some Helicone materials but not confirmed as embedding-based semantic caching in primary docs.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Budgets and quotas | SupportedCost and token budgets per API key.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Rate limiting | PartialLocal sliding-window request limits plus optional Redis-coordinated fixed window across replicas; no token-based (TPM) limiter.
Local sliding-window request limits plus optional Redis-coordinated fixed window across replicas; no token-based (TPM) limiter. | SupportedBuilt-in rate limiting (GCRA-based) documented.
| Managed only |
| Token-based rate limits | Not verifiedNo claim is recorded for this capability in the pinned register.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedNo claim is recorded for this capability in the pinned register.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedNo claim is recorded for this capability in the pinned register.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Identity & guardrails | |||
| API key management | SupportedHashed API keys, bootstrap owner key, workspace-scoped keys.
| SupportedAPI key management documented.
| Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| OIDC / JWT identity | SupportedOIDC JWT/JWKS workload identity (identity.oidc.jwks_url/issuer/audience).
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Mutual TLS | Not availableExplicitly not implemented; listed as a roadmap item, not a shipped feature.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| RBAC / policy engine (CEL or equivalent) | SupportedCEL allow/deny authorization rules plus fixed role gates.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Built-in guardrails | SupportedBuilt-in PII/prompt-injection/SQL-injection/toxicity/secret detectors plus custom regex rules, single-pass Rust-WASM scan with pure-Go fallback.
| Not verifiedSecurity/request validation documented; no formal "guardrails" product label found in the strongest available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Guardrail webhooks / external connectors | SupportedHTTP webhook connectors with configurable stage/action/timeout/fail_open.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Output redaction | Supportedredact action available on output-stage guardrail rules.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Guardrails applied to streaming output | Supportedguardrails.stream_buffer defaults to true: the full SSE stream is buffered and scanned before release, which means TTFT with guardrails on is dominated by upstream generation time, not gateway overhead. Benchmark both stream_buffer=true and false and label them.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Governed agent infrastructure | |||
| MCP gateway | SupportedHTTP MCP targets with streamed SSE / streamable-HTTP pass-through.
| Not verifiedNo evidence of MCP support found in available sources; unconfirmed, not necessarily absent.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| MCP over stdio | SupportedPersistent stdio MCP transport targets.
| Not verifiedSame as above.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| MCP federation (multiple targets) | SupportedMultiple named MCP targets, policy-gated tools/call, server-side headers.
| Not verifiedSame as above.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| OpenAPI-to-MCP conversion | Not availableNot implemented; explicit gap in the project's own comparison doc.
| Not verifiedSame as above.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| MCP OAuth / token exchange | SupportedRFC 8693 token exchange plus RFC 7523 JWT Bearer Grant for MCP OAuth delegation.
| Not verifiedSame as above.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| A2A agent card discovery | SupportedPublic A2A v1 Agent Card discovery (/.well-known/agent-card.json) plus authenticated GetExtendedAgentCard.
Current protocol scope: SendMessage, SendMessageStream (SSE task events), GetTask, best-effort CancelTask; tasks in memory; no push notifications; no downstream agent proxy. | Not availableNo A2A support found in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| A2A task methods | PartialSendMessage / SendMessageStream, GetTask, CancelTask implemented (JSON-RPC methods and REST aliases). Agent card advertises pushNotifications: false, so push-notification task updates are not supported.
Current protocol scope: SendMessage, SendMessageStream (SSE task events), GetTask, best-effort CancelTask; tasks in memory; no push notifications; no downstream agent proxy. SendMessage / SendMessageStream, GetTask, CancelTask implemented (JSON-RPC methods and REST aliases). Agent card advertises pushNotifications: false, so push-notification task updates are not supported. | Not availableNo A2A support found in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Operations & evidence | |||
| Prompt management | PartialTemplates with version history and rendering; no approval workflow, rollback/promotion, or experiments.
Templates with version history and rendering; no approval workflow, rollback/promotion, or experiments. | Not verifiedHelicone's broader observability platform has prompt features; AI-Gateway-specific prompt management not confirmed.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Evals / experiments | PartialPolicy replay endpoint for batch allow/deny simulation only; no model-quality eval datasets/scoring.
Policy replay endpoint for batch allow/deny simulation only; no model-quality eval datasets/scoring. | Not verifiedNot confirmed for the AI Gateway component specifically.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| OTLP telemetry export | SupportedOTel trace export (tested against Langfuse/Jaeger/Tempo).
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Prometheus metrics | Supported/metrics endpoint, gated by OMNISWITCH_PROMETHEUS_ENABLED.
| Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedManaged service: capability-map only, no same-host benchmark run. Not verified in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
| Published cross-gateway benchmarks | PartialIn-repo Rust-WASM-vs-Go guardrail micro-benchmark only (BENCHMARKS.md, measured on a non-pinned Windows laptop). No cross-gateway comparative run published yet -- this benchmark effort (bench/) is that follow-up.
In-repo Rust-WASM-vs-Go guardrail micro-benchmark only (BENCHMARKS.md, measured on a non-pinned Windows laptop). No cross-gateway comparative run published yet -- this benchmark effort (bench/) is that follow-up. | Not availableNo formal published overhead benchmark found for the Helicone AI Gateway.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ | Not verifiedNot confirmed in available sources.
No capability-specific source was recorded. The register is the provenance, not proof of absence. Open pinned register ↗ |
Deployment & license
Self-hosted deployment
- OmniSwitch[1]
Not verified
No claim is recorded for this capability in the pinned register.
- Version
- Not recorded
- Verified
- Not recorded
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Helicone[4]
Not verified
No claim is recorded for this capability in the pinned register.
- Version
- Not recorded
- Verified
- Not recorded
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
No claim is recorded for this capability in the pinned register.
- Version
- Not recorded
- Verified
- Not recorded
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
SQLite / Postgres storage
- OmniSwitch[1]
Supported
SQLite by default; PostgreSQL via OMNISWITCH_DATABASE_URL. Logs and keys remain SQLite-local even in the Postgres case per the project's own docs.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not available
Documented cache/rate-limit backends are Redis and S3, not SQLite/Postgres.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Kubernetes manifests / Helm chart
- OmniSwitch[1]
Supported
Kustomize manifests (Deployment/Service/ConfigMap/Secret example/PVCs/Redis) plus a Helm chart; no operator/CRDs/inference-aware routing.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Config hot reload
- OmniSwitch[1]
Supported
Config hot reload covers routes, guardrails, cache posture, circuit breaker, and shadow provider without restart.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Built-in dashboard/UI
- OmniSwitch[1]
Supported
Local dashboard for logs, metrics, prompts, providers, and guardrails.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Helicone's broader product has a hosted dashboard; a bundled dashboard inside the self-hosted AI Gateway container is not confirmed.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Managed only
Hosted observability dashboard is Helicone's core product.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
License
- OmniSwitch[1]
Supported
- Helicone[4]
Supported
GPL-3.0 (verified via the repository's GitHub license metadata; some third-party articles incorrectly state Apache-2.0/MIT).
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Not available
Closed managed service (distinct from the GPL-3.0 self-hosted AI Gateway).
- Version
- hosted service, n/a
- Verified
- 2026-09-11
APIs & providers
OpenAI-compatible chat completions
- OmniSwitch[1]
Supported
/v1/chat/completions, streaming and non-streaming.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Supported
Single OpenAI-compatible endpoint routing 100+ models/providers.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Managed only
Hosted proxy/observability across 100+ models.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
OpenAI-compatible embeddings
- OmniSwitch[1]
Supported
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
OpenAI Responses API
- OmniSwitch[1]
Partial
/v1/responses text subset only (no image/audio/tool-streaming parity with OpenAI).
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
/v1/responses text subset only (no image/audio/tool-streaming parity with OpenAI).
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Anthropic Messages API
- OmniSwitch[1]
Partial
/v1/messages core subset.
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Native (non-passthrough) provider adapters
- OmniSwitch[1]
Partial
4 native adapters (OpenAI, Anthropic, Google, Groq); no native Bedrock/Vertex/Cohere. Everything else goes through the generic OpenAI-compatible custom adapter with 15+ documented presets.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
4 native adapters (OpenAI, Anthropic, Google, Groq); no native Bedrock/Vertex/Cohere. Everything else goes through the generic OpenAI-compatible custom adapter with 15+ documented presets.
- Helicone[4]
Supported
100+ providers/models claimed.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Custom/generic OpenAI-compatible endpoint
- OmniSwitch[1]
Supported
Generic custom provider adapter with presets for Azure OpenAI, Ollama, vLLM, LiteLLM, DeepSeek, Together, Fireworks, and aliases.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Routing, reliability & cost
Routing & fallbacks
- OmniSwitch[1]
Supported
route-level fallbacks, max_retries, retry_backoff, retry_codes, per-attempt timeout.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Supported
Failover documented as a core feature.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Weighted / load-balanced routing
- OmniSwitch[1]
Supported
Weighted variants per route.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Supported
Load balancing documented as a core feature.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Conditional routing (rule/expression based)
- OmniSwitch[1]
Supported
CEL condition expressions on route variants.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Circuit breaker
- OmniSwitch[1]
Supported
Default 5 failures / 60s cooldown, configurable via gateway.circuit_breaker_failures / _cooldown.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Health/rate-limit-aware routing documented; a distinct circuit-breaker feature not confirmed.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Exact-match cache
- OmniSwitch[1]
Supported
SHA-256 request-fingerprint cache key, tenant-scoped (api_key/workspace/organization/global), SQLite-backed.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Supported
Response caching (Redis/S3 backends) documented.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Managed only
Similarity cache (see scope)
- OmniSwitch[1]
Supported
NOT embedding-based. Vectorize() builds a normalized token-frequency map over lowercased, stop-word-filtered tokens; Similarity() is cosine over those token-frequency vectors. State this precisely wherever OmniSwitch's cache is compared to embedding-based semantic caches.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
"Intelligent caching" is mentioned in some Helicone materials but not confirmed as embedding-based semantic caching in primary docs.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Budgets and quotas
- OmniSwitch[1]
Supported
Cost and token budgets per API key.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Rate limiting
- OmniSwitch[1]
Partial
Local sliding-window request limits plus optional Redis-coordinated fixed window across replicas; no token-based (TPM) limiter.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
Local sliding-window request limits plus optional Redis-coordinated fixed window across replicas; no token-based (TPM) limiter.
- Helicone[4]
Supported
Built-in rate limiting (GCRA-based) documented.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Managed only
Token-based rate limits
- OmniSwitch[1]
Not verified
No claim is recorded for this capability in the pinned register.
- Version
- Not recorded
- Verified
- Not recorded
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Helicone[4]
Not verified
No claim is recorded for this capability in the pinned register.
- Version
- Not recorded
- Verified
- Not recorded
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
No claim is recorded for this capability in the pinned register.
- Version
- Not recorded
- Verified
- Not recorded
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Identity & guardrails
API key management
- OmniSwitch[1]
Supported
Hashed API keys, bootstrap owner key, workspace-scoped keys.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Supported
API key management documented.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
OIDC / JWT identity
- OmniSwitch[1]
Supported
OIDC JWT/JWKS workload identity (identity.oidc.jwks_url/issuer/audience).
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Mutual TLS
- OmniSwitch[1]
Not available
Explicitly not implemented; listed as a roadmap item, not a shipped feature.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
RBAC / policy engine (CEL or equivalent)
- OmniSwitch[1]
Supported
CEL allow/deny authorization rules plus fixed role gates.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Built-in guardrails
- OmniSwitch[1]
Supported
Built-in PII/prompt-injection/SQL-injection/toxicity/secret detectors plus custom regex rules, single-pass Rust-WASM scan with pure-Go fallback.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Security/request validation documented; no formal "guardrails" product label found in the strongest available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Guardrail webhooks / external connectors
- OmniSwitch[1]
Supported
HTTP webhook connectors with configurable stage/action/timeout/fail_open.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Output redaction
- OmniSwitch[1]
Supported
redact action available on output-stage guardrail rules.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Guardrails applied to streaming output
- OmniSwitch[1]
Supported
guardrails.stream_buffer defaults to true: the full SSE stream is buffered and scanned before release, which means TTFT with guardrails on is dominated by upstream generation time, not gateway overhead. Benchmark both stream_buffer=true and false and label them.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Governed agent infrastructure
MCP gateway
- OmniSwitch[1]
Supported
HTTP MCP targets with streamed SSE / streamable-HTTP pass-through.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
No evidence of MCP support found in available sources; unconfirmed, not necessarily absent.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
MCP over stdio
- OmniSwitch[1]
Supported
Persistent stdio MCP transport targets.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Same as above.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
MCP federation (multiple targets)
- OmniSwitch[1]
Supported
Multiple named MCP targets, policy-gated tools/call, server-side headers.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Same as above.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
OpenAPI-to-MCP conversion
- OmniSwitch[1]
Not available
Not implemented; explicit gap in the project's own comparison doc.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Same as above.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
MCP OAuth / token exchange
- OmniSwitch[1]
Supported
RFC 8693 token exchange plus RFC 7523 JWT Bearer Grant for MCP OAuth delegation.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Same as above.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
A2A agent card discovery
- OmniSwitch[1]
Supported
Public A2A v1 Agent Card discovery (/.well-known/agent-card.json) plus authenticated GetExtendedAgentCard.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
Current protocol scope: SendMessage, SendMessageStream (SSE task events), GetTask, best-effort CancelTask; tasks in memory; no push notifications; no downstream agent proxy.
- Helicone[4]
Not available
No A2A support found in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
A2A task methods
- OmniSwitch[1]
Partial
SendMessage / SendMessageStream, GetTask, CancelTask implemented (JSON-RPC methods and REST aliases). Agent card advertises pushNotifications: false, so push-notification task updates are not supported.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
Current protocol scope: SendMessage, SendMessageStream (SSE task events), GetTask, best-effort CancelTask; tasks in memory; no push notifications; no downstream agent proxy.
SendMessage / SendMessageStream, GetTask, CancelTask implemented (JSON-RPC methods and REST aliases). Agent card advertises pushNotifications: false, so push-notification task updates are not supported.
- Helicone[4]
Not available
No A2A support found in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Operations & evidence
Prompt management
- OmniSwitch[1]
Partial
Templates with version history and rendering; no approval workflow, rollback/promotion, or experiments.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
Templates with version history and rendering; no approval workflow, rollback/promotion, or experiments.
- Helicone[4]
Not verified
Helicone's broader observability platform has prompt features; AI-Gateway-specific prompt management not confirmed.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Evals / experiments
- OmniSwitch[1]
Partial
Policy replay endpoint for batch allow/deny simulation only; no model-quality eval datasets/scoring.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
Policy replay endpoint for batch allow/deny simulation only; no model-quality eval datasets/scoring.
- Helicone[4]
Not verified
Not confirmed for the AI Gateway component specifically.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
OTLP telemetry export
- OmniSwitch[1]
Supported
OTel trace export (tested against Langfuse/Jaeger/Tempo).
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Prometheus metrics
- OmniSwitch[1]
Supported
/metrics endpoint, gated by OMNISWITCH_PROMETHEUS_ENABLED.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
- Helicone[4]
Not verified
Not confirmed in available sources.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Managed service: capability-map only, no same-host benchmark run. Not verified in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
Published cross-gateway benchmarks
- OmniSwitch[1]
Partial
In-repo Rust-WASM-vs-Go guardrail micro-benchmark only (BENCHMARKS.md, measured on a non-pinned Windows laptop). No cross-gateway comparative run published yet -- this benchmark effort (bench/) is that follow-up.
- Version
- v0.2.0-beta (commit 88a27c0)
- Verified
- 2026-09-11
In-repo Rust-WASM-vs-Go guardrail micro-benchmark only (BENCHMARKS.md, measured on a non-pinned Windows laptop). No cross-gateway comparative run published yet -- this benchmark effort (bench/) is that follow-up.
- Helicone[4]
Not available
No formal published overhead benchmark found for the Helicone AI Gateway.
- Version
- latest @ docker.io/helicone/ai-gateway:latest sha256:bdf1f7c4f3aa177b8a03a02d461c744733c0292afd95d3185337d9fc2c346af6
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗- Managed platform
Not verified
Not confirmed in available sources.
- Version
- hosted service, n/a
- Verified
- 2026-09-11
No capability-specific source was recorded. The register is the provenance, not proof of absence.
Open pinned register ↗
OmniSwitch scope. The pinned register marks OpenAI Responses API, Anthropic Messages API, Native (non-passthrough) provider adapters, Rate limiting, Mutual TLS, OpenAPI-to-MCP conversion, A2A task methods, Prompt management, Evals / experiments, Published cross-gateway benchmarks as partial or unavailable. Read each source and version; compare them with the build you actually deploy.
Read unknowns carefully. “Not verified” means an evidence gap, not absence. Editions remain separate. Register a8a594b; 3 compared deployments.
A2A (Beta). SendMessage, SendMessageStream (SSE task events), GetTask, best-effort CancelTask; tasks in memory; no push notifications; no downstream agent proxy.
A starting point from Helicone
The register verifies OpenAI-compatible chat on both sides. This guide is limited to an OpenAI SDK base-URL change for chat; it does not establish compatibility for other APIs or headers.
- Inventory routes, custom headers, and metadata.
- Map keys, fallback behavior, and log fields.
- Pilot representative calls and inspect traces before moving traffic.
Create an OmniSwitch gateway API key. The SDK sends it as Authorization: Bearer <OmniSwitch key>. Provider credentials stay in the gateway; do not reuse your competitor platform key.
Pilot with the OpenAI Python SDKPython
import os
from openai import OpenAI
client = OpenAI(
base_url="http://localhost:8080/v1",
api_key=os.environ["OMNISWITCH_KEY"],
)
response = client.chat.completions.create(
model="gpt-4o-mini",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Pilot with the OpenAI Node SDKJavaScript
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "http://localhost:8080/v1",
apiKey: process.env.OMNISWITCH_KEY,
});
const response = await client.chat.completions.create({
model: "gpt-4o-mini",
messages: [{ role: "user", content: "Hello" }],
});
console.log(response.choices[0].message.content);Map headers explicitly
x-omniswitch-providerMap your Helicone equivalent here.x-omniswitch-configMap your Helicone equivalent here.x-omniswitch-trace-idMap your Helicone equivalent here.x-omniswitch-session-idMap your Helicone equivalent here.x-omniswitch-shadow-providerMap your Helicone equivalent here.
Chat selects its model with the JSON model field. The x-omniswitch-model header is an A2A selector, not a chat model override.
Read Helicone’s header documentation and the OmniSwitch header reference. Custom header conventions, automatic configuration import, gateway-key import, and direct Anthropic SDK header support are not implied.
Pilot representative blocking and streaming calls, tools, errors, retries, metadata, and observability. Keep the original gateway available until your app-level tests pass.
Dated market context
Helicone → Mintlify
Helicone announced it was joining Mintlify on 3 March 2026. Services remain live in maintenance mode, with security updates, new models, and fixes continuing.
Source · accessed 2026-10-09Sources & methodology
- [1]
OmniSwitch
Product register a8a594b. Cells reflect registered source claims, not roadmap plans or release-artifact availability; each retains its own verified date and version.
- [4]
Helicone
OSS gateway; maintenance context. Capability-specific documentation and dated editorial sources remain separate from independent testing.
Supported means documented within the named capability and deployment scope, not full product parity. Beta and licensed editions are shown when the register supplies a qualifier. Not verified describes an evidence gap, not absence. Claims come from the pinned register; cells have no scores or totals. This is a dated documentation review, not a performance test or a security certification. See the benchmark methodology.