Feedback

Collect and manage feedback on your Scout outputs

Feedback allows you to collect ratings and comments on outputs from your Scout workflows, agents, and more. Whether you’re gathering end-user reactions or enabling your team to review and triage outputs, feedback provides the insights you need to improve over time.

Feedback is currently available for workflows. Support for agents and other targets is coming soon.

Use Cases

External Feedback

Collect ratings from your end-users. Understand what’s working well and where improvements are needed.

Internal Review

Enable your team to review, triage, and track outputs. Assign issues, set priorities, and resolve problems systematically.

Key Concepts

Targets

Feedback is attached to a target - the specific output you want feedback on. Each execution of a workflow (or agent session, etc.) can have feedback associated with it, allowing you to track quality at the individual output level.

Scorers

Feedback uses scorers to define what type of feedback to collect. The thumbs scorer is the built-in option for simple thumbs up/down ratings:

ScoreMeaning
1Thumbs up - the output was good
0Thumbs down - the output needs improvement
Custom scorers with different rating scales (e.g., 1-5 stars, multi-dimensional scores) are coming soon.

Users

To track who gave feedback, include a user object:

1{
2  "user": {
3    "id": "user_456",
4    "metadata": { "plan": "pro" }
5  }
6}

The id is required. The metadata is optional context about the user (useful for segmenting feedback later).

Feedback Statuses

The status workflow helps you triage and resolve issues surfaced by negative feedback. Positive feedback is valuable for tracking what’s working but typically doesn’t require action.

StatusDescription
newJust received, not yet triaged
reviewingTeam is investigating the issue
resolvedIssue was fixed (prompt updated, model tuned, etc.)
dismissedNot actionable (user error, expected behavior, etc.)

Typical workflow for negative feedback: new → reviewing → resolved / dismissed

Positive feedback can stay as new (it’s just signal) or be bulk-dismissed if you want a clean triage queue.

Feedback Dashboard

View and manage all feedback from the Feedback page in Scout.

The dashboard lets you:

  • View all feedback in a sortable table with score, status, priority, and comments
  • Filter and search by status, priority, or comment text
  • Assign feedback to team members for review
  • Update status to track progress from new → reviewing → resolved
  • View context with direct links to the workflow run that generated the output

Click any feedback row to open the details panel, where you can see the full comment, update status, assign reviewers, and add internal notes.

Next Steps

Collecting Feedback

Learn how to set up feedback collection via the API