OmniRoute¶
Self-hosted AI proxy that routes LLM requests to many providers through one endpoint
| Chart | omniroute |
| Version | 0.3.4 |
| Application version | 3.8.49 |
| Kind | Application |
| Source | charts/omniroute |
The values are listed under Values, the changes per version under Changelog.
Purpose¶
OmniRoute is a self-hosted AI proxy: one endpoint that routes LLM requests to the providers you configure in its dashboard. The chart runs the upstream image with a Redis instance and two volumes.
Install¶
helm repo add grncloud https://apps.openshift.eu
helm install omniroute grncloud/omniroute
Read the address and the first password:
oc get route omniroute -o jsonpath='https://{.spec.host}{"\n"}'
oc get secret omniroute-secret -o jsonpath='{.data.INITIAL_PASSWORD}' | base64 -d
| Value | Default | Meaning |
|---|---|---|
route.hostname |
empty | Hostname of the dashboard. Empty: OpenShift assigns one. |
persistence.size |
5Gi |
Size of the data volume. |
secrets.type |
kubernetes |
externalSecret reads the four secrets from a secret store. |
secrets.initialPassword |
empty | First dashboard password. Empty: generated. |
image.tag |
chart appVersion | Upstream image tag. |
build.enabled |
false |
Build the image from source in your project instead. Takes about an hour and 8Gi of memory. |
Secrets left empty are generated at the first install and kept on every upgrade with
helm upgrade. A tool that renders the chart without access to the cluster, such as
Argo CD or helm template, cannot read the existing Secret and generates new values on
every render: set all four secrets there.
Delivery instructions¶
- A hostname outside the default application domain needs a DNS record pointing at the platform's ingress. Ask the platform team for the record; the certificate follows automatically once it resolves.
- With
secrets.type=externalSecret, create four items in your vault collection, named as insecrets.externalSecret.items, each with the value in the password field, and setsecrets.externalSecret.storeNameto your store.