Inferix

API reference

Shipped APIs: LensAI ingest HTTP and distributed-flagd. Suite :4000 control plane is a design target.

Documented below are APIs you can hit in the runnable LensAI stack. A suite-wide control plane on :4000 is a design target — listed separately so it is never confused with shipped surface.

Ports that exist today

PortServiceRole
:8080lensai-ingest / ingestionHTTP ingest + health + Prometheus
:8081distributed-flagdFeature flags HTTP
:50051distributed-flagdFeature flags gRPC
:3000GrafanaDashboards (admin/admin in quickstart)
:9090PrometheusMetrics
:8123ClickHouse HTTPQueries / smoke verification

Source: infra-ai-streaming and lensai-integration.

Ingest HTTP (shipped)

Streaming engine exposes POST /ingest (infra-ai-streaming). The integration quickstart smoke path uses POST /events on the same port — follow the path your Compose file wires.

# infra-ai-streaming (ingestion)
POST http://localhost:8080/ingest
Content-Type: application/json
X-Tenant-ID: demo

{
  "events": [
    {
      "tenant_id": "demo",
      "model_id": "gpt-4o",
      "timestamp_unix_ms": 1715000000000,
      "latency_ms": 342,
      "prompt_tokens": 512,
      "completion_tokens": 128,
      "cost_usd": 0.00423,
      "status": "success"
    }
  ]
}

# Health
GET http://localhost:8080/health

Durability: accept → WAL → Kafka/Redpanda; ClickHouse is eventually consistent. See DESIGN.md.

distributed-flagd (shipped)

etcd-backed feature flags for model rollout / kill-switch style control. Runs in the lensai-integration stack on :8081.

# List / read flags
GET  http://localhost:8081/flags
GET  http://localhost:8081/flags/{name}

# Create / update (shape depends on flag definition)
POST http://localhost:8081/flags
PUT  http://localhost:8081/flags/{name}
Content-Type: application/json

# Evaluate a flag for a context
POST http://localhost:8081/evaluate

# Health
GET  http://localhost:8081/health

Example from the integration README (runtime update):

curl -X PUT http://localhost:8081/flags/model-router-v2 \
  -H "Content-Type: application/json" \
  -d '{"state":"ENABLED","variants":{"claude-3-5-sonnet":0.9,"claude-opus-4-8":0.1},"defaultVariant":"claude-3-5-sonnet"}'

Code: distributed-flagd/.

Target — suite control plane (:4000)

Design target / not shipped

Design target / not shipped The following endpoints describe the intended suite API when a unified Inferix control plane exists. They are not available from make up in lensai-integration today.

  • GET /health on :4000
  • POST /v1/chat/completions — OpenAI-shaped ingress (connect detail only; not the product definition)
  • GET /v1/models, GET /v1/observe/metrics, GET /v1/traces
  • GET/PUT /v1/policies (RouteIQ suite API) — Design target; RouteIQ modules exist in streaming, not as this HTTP surface yet
  • GET /v1/drift/alerts, POST /v1/fineforge/jobs — DriftWatch / FineForge are Scaffold

Maturity table: Status & maturity. Loop thesis: Architecture.