Quick overview
Quick overview This workflow uses the Judgment API community node to grade multiple AI answers against a reference answer, calculates a trust verdict from probabilities and confidence, and routes each grade into “trusted” results versus items that need human review. How it works Runs when you manually click Test Workflow. Loads a sample set of three question/answer/reference triples (or your own source of answers). Sends each item to the n8n-nodes-judgment “Grade Answers” action to evaluate correctness, completeness, groundedness, relevance, clarity, and an overall ship/edit/reject decision. Normalizes each judgment into a consistent output (value, a 0–1 score, and judge confidence) and applies trust rules based on confidence or distance from 0.5. Routes rows marked as trusted to the “Trusted Grades” output and sends everything marked “needs review” to the human-review output. Setup Install the community node package n8n-nodes-judgment in n8n (Settings → Community Nodes). Create and add a Judgment API credential (API key) and select it in the “Grade Answers” step. Replace the sample answers source with your own inputs (your LLM output, a database, or a sheet) and adjust the trust thresholds in the verdict mapping if needed. An n8n automation workflow template by Greg Evseev.
Greg Evseev
web
free
Others in the same category, ranked by how often they are opened.
