issuegraph
A GitHub issue triage agent built on LangGraph. It classifies an issue, routes it to a specialist drafter, loops the reply through a quality guard, and pauses for your approval before finalizing, on demand or whenever its own confidence is low. This page runs the real graph, streaming each node as it executes.
Pick a preset above. You will watch the LangGraph state machine run node by node: classify, route to a specialist drafter, loop through a quality guard, then either finalize or stop and ask you to approve. The last preset is intentionally ambiguous and usually pauses the graph for human review.
| confidence bucket | n | claimed | actual | verdict |
|---|---|---|---|---|
| 0.9-1.0 | 8 | 0.95 | 1.00 | calibrated |
A fixed reference run, committed at build time from 8labeled issues, scored two ways: deterministic exact-match on the category, and an LLM judge on the drafted reply. The Brier score and reliability table check whether the classifier's stated confidence is honest. This one does not move between deploys; the live scoreboard above grows with real visitor runs. Small clean golden sets flatter the model; the interesting work is growing the set with production failures.