Agent Infrastructure · Startup idea
Agent observability: Datadog for the LLM stack
Agents are non-deterministic and expensive. Datadog doesn't know what to do with a tool-call trace. The dedicated observability tool wins because the data shape is different.
Why now
Langsmith, Helicone, and Weave are racing for the category. None of them is the obvious winner, the market is too early, and the buyer is the engineering manager who already pays for Datadog. The wedge is per-feature pricing on top of an existing trace pipeline.
The idea you could build today
OpenTelemetry-compatible span format for LLM calls. Capture prompt, response, tools, cost, latency. Drop into Grafana / Datadog as a layer on top, or self-host. Free for the first 10K spans/month, that's the indie tier.
Build stack
- ·OpenTelemetry SDK
- ·ClickHouse for the trace storage
- ·Next.js dashboard
- ·Vercel for the ingest endpoint
The three repos already trying
Pulled live from our current-period signal index.
No repos in the current period have crossed our minimum-volume + sector match for this idea. That can mean two things, the niche is too new for public GitHub signal to show up yet, or the buildable wedge is genuinely greenfield. Either way, watch this page; matches refresh weekly.
Matched against the current-period startup signal panel (developer-tools, ai-ml). Rankings shift weekly as the underlying GitHub activity moves. Read the methodology.
The seed-round pattern hiding in the trendline
OSS observability repos that ship an LLM-span exporter in the same quarter their core observability product gets a velocity bump are the seed-stage tells.
Frequently asked
Won't Datadog just add LLM tracing?+
They already did, and it's an afterthought. The agent-observability winner is the product that's LLM-native from day one and integrates with everything else as an export.
Use the signal, not just the idea
Watch this idea live, every week.
The repos above re-rank automatically as commit velocity, contributor growth, and new-repo creation move. Want the data feed for this idea wired into your own stack? The MCP server exposes every signal as a tool any agent host can query.
Related ideas
Updated 2026-08-25. The framing is editorial; the “three repos already trying” slot is generated from the live signal panel. Anonymity rule: we name public GitHub orgs, never individual founders or stealth teams.