Products

TraceForge

Follow one request across tools, models, and agent steps. TraceForge is the span layer of the control plane — RCA and required-step correctness, next to your existing traces.

When to use

  • Multi-step agents where tool order and skips matter
  • You need business success, not just HTTP 200
  • N+1 tool loops, retry storms, or planner infinite loops

Span model

inferix.call                    # root — keep always (T17)
├── routeiq.decide              # route_decision, model_id
├── agent.tool.<taxonomy>       # tool_name, schema version
├── gen_ai.chat                 # model invoke (OTel gen_ai)
└── hitl.wait                   # optional — tag exclusive waits (T20)

Use OpenTelemetry gen_ai.* attributes. Propagate trace_id / baggage across multi-agent handoffs (T22). Versioned tool taxonomy keeps step names stable (T24).

Business success

HTTP 200 is not success

A refund tool can return 200 while the agent skipped policy.check_refund. TraceForge records business_success from a domain predicate. Dashboards use traceforge.tasks.succeeded and traceforge.steps.skipped_required.

Key metrics

  • traceforge.tasks.started/succeeded/failed
  • traceforge.tools.error_rate, tools.p99, tools.retries
  • traceforge.graph.n_plus_one, graph.exclusive_time_ms
  • traceforge.steps.skipped_required, replay.available

Operator failure modes

IDProblemNext action
T01Required step missingHard gate + alert
T03Tool 4xx schema errorBump schema; FineForge adapter
T05Retry amplificationCap retries; backoff
T06N+1 tool loopsBatch tool; cache
T07Infinite planner loopMax steps; kill switch
T11Hallucinated tool argsValidate before execute
T12Partial success unmarkedBusiness-success predicate
T14PII in tool argsHash args; vault payload
T16Orphan spansFix context propagation in SDK
T23Cost missing on tool spansDual-write LensAI cost

Config

observe:
  traces: true
  otlp_endpoint: http://otel-collector:4317
  taxonomy: /etc/inferix/tool-taxonomy.yaml
  keep_root_always: true
  redact_tool_args: true

Query API: GET /v1/traces. Client patterns: SDKs.

Source

https://github.com/AkshantVats/agent-trace-collector

Cheap SLM, general, hard path, cache, budgets.

RouteIQ →