Products
TraceForge
Follow one request across tools, models, and agent steps. TraceForge is the span layer of the control plane — RCA and required-step correctness, next to your existing traces.
When to use
- Multi-step agents where tool order and skips matter
- You need business success, not just HTTP 200
- N+1 tool loops, retry storms, or planner infinite loops
Span model
inferix.call # root — keep always (T17) ├── routeiq.decide # route_decision, model_id ├── agent.tool.<taxonomy> # tool_name, schema version ├── gen_ai.chat # model invoke (OTel gen_ai) └── hitl.wait # optional — tag exclusive waits (T20)
Use OpenTelemetry gen_ai.* attributes. Propagate trace_id / baggage across multi-agent handoffs (T22). Versioned tool taxonomy keeps step names stable (T24).
Business success
HTTP 200 is not success
A refund tool can return 200 while the agent skipped policy.check_refund. TraceForge records business_success from a domain predicate. Dashboards use traceforge.tasks.succeeded and traceforge.steps.skipped_required.
Key metrics
traceforge.tasks.started/succeeded/failedtraceforge.tools.error_rate,tools.p99,tools.retriestraceforge.graph.n_plus_one,graph.exclusive_time_mstraceforge.steps.skipped_required,replay.available
Operator failure modes
| ID | Problem | Next action |
|---|---|---|
| T01 | Required step missing | Hard gate + alert |
| T03 | Tool 4xx schema error | Bump schema; FineForge adapter |
| T05 | Retry amplification | Cap retries; backoff |
| T06 | N+1 tool loops | Batch tool; cache |
| T07 | Infinite planner loop | Max steps; kill switch |
| T11 | Hallucinated tool args | Validate before execute |
| T12 | Partial success unmarked | Business-success predicate |
| T14 | PII in tool args | Hash args; vault payload |
| T16 | Orphan spans | Fix context propagation in SDK |
| T23 | Cost missing on tool spans | Dual-write LensAI cost |
Config
observe: traces: true otlp_endpoint: http://otel-collector:4317 taxonomy: /etc/inferix/tool-taxonomy.yaml keep_root_always: true redact_tool_args: true
Query API: GET /v1/traces. Client patterns: SDKs.
Source
Cheap SLM, general, hard path, cache, budgets.
RouteIQ →