issuegraph
A GitHub issue triage agent built on LangGraph. It classifies an issue, routes it to a specialist drafter, loops the reply through a quality guard, and pauses for human approval when its own confidence is low. This page runs the real graph, streaming each node as it executes.
Pick a preset above. You will watch the LangGraph state machine run node by node: classify, route to a specialist drafter, loop through a quality guard, then either finalize or stop and ask you to approve. The last preset is intentionally ambiguous and usually pauses the graph for human review.
| confidence bucket | n | claimed | actual | verdict |
|---|---|---|---|---|
| 0.9-1.0 | 8 | 0.95 | 1.00 | calibrated |
Numbers from the committed golden-set run (8 labeled issues) scored two ways: deterministic exact-match on the category, and an LLM judge on the drafted reply. The Brier score and reliability table check whether the classifier's stated confidence is honest. Small clean golden sets flatter the model; the interesting work is growing the set with production failures.