Managed control plane. Your data plane. Prompts never leave your network.
ManyLayers Hybrid gives you the operational simplicity of a managed service — dashboard, policy engine, automatic upgrades — while the request-serving data plane runs entirely inside your own VPC or on-premises environment.
Two planes, one platform.
Managed by ManyLayers
Control Plane
- Dashboard and admin UI
- Routing policy and alias configuration
- Guardrail and budget rules
- Upgrade orchestration and rollback
- Usage dashboards and cost analytics
Runs in your VPC / on-prem
Data Plane
- All prompt and completion traffic
- PII firewall and guardrail enforcement
- Semantic cache and embedding store
- Audit log writes to your Postgres/S3
- On-prem model serving (Deploy module)
Managed operations. Sovereign data.
Managed control plane
ManyLayers operates the dashboard, configuration API, policy engine, and upgrade pipeline. No control-plane Kubernetes to manage — we handle rollouts, patches, and SLA.
Data plane in your VPC
The request-serving data plane runs inside your own cloud VPC or on-prem network. All prompt traffic, completions, embeddings, and vector queries stay entirely within your perimeter.
Zero data egress
Provider API calls, conversation history, PII-filtered payloads, and audit events never traverse the public internet. Only control-plane metadata (config, health heartbeats) leaves your network.
Compliance without overhead
Satisfy HIPAA, FedRAMP-adjacent, and financial-sector data residency requirements without standing up and operating the full control plane yourself.
Automatic upgrades
ManyLayers pushes data-plane version updates through the managed control plane during your configured maintenance window. Zero-downtime rolling upgrades, no manual Helm commands.
Unified observability
Dashboards, cost tracking, provider latency, cache hit rates, and guardrail events surface in the managed UI — while raw audit logs are written locally to your Postgres or S3 bucket.
Cloud, Hybrid, and Self-Hosted side by side.
| Feature | SaaS Cloud | Hybrid | Self-Hosted |
|---|---|---|---|
| Infrastructure management | Fully managed | Control plane managed; data plane yours | Your team |
| Data residency | Our cloud (region-locked) | Your VPC / on-prem | Your data centre |
| Prompt & data egress | Leaves your network | Stays in your network | Stays in your network |
| Upgrades | Automatic | Automatic (data plane) | Self-managed |
| Air-gapped operation | Not available | Partial — control plane requires reach | Supported |
| SSO / RBAC | Included | Included | Included |
| Audit log | Included, exportable | Written locally to your storage | Included, exportable |
| On-prem model deployment | Not available | Supported (Deploy module on your nodes) | Supported (Deploy module) |
| Pricing model | Subscription | Subscription + data-plane infra cost | License + your infra cost |
| Setup time | Minutes | Hours | Hours to days |