> ## Documentation Index
> Fetch the complete documentation index at: https://koreai.mintlify.app/llms.txt
> Use this file to discover all available pages before exploring further.

# By Manual Evaluation Metric

Manual evaluation metrics enable QA teams to assess agent performance through human review when automated detection is unreliable. QA managers configure these metrics in the form and assign weights in points, allowing auditors to manually evaluate criteria instead of using AutoQA, particularly for complex scenarios where automation may lack accuracy.

## What It Offers

* Provides controlled, auditor-only assessment within Points-Based evaluation forms.
* QA auditors evaluate the metric manually.
* The metric contributes to overall form scoring within Points-Based forms without affecting Percentage-Based structures.
* Prevents misleading automated outcomes.
* The system excludes metrics, such as LLM-based evaluation, Deterministic Auto QA, Agent Auto QA analytics, and Agent Attributes or Agent Scorecards.

## When to Use This Metric

* **Nuanced Communication Assessment**: Emotional intelligence, Tone appropriateness, Context-sensitive empathy.
* **Regulatory or Compliance Interpretation**: Policy adherence requiring contextual interpretation, Industry-specific compliance checks, and legal disclaimers.
* **Low AI Confidence Areas**: Complex escalation handling, Multi-layered issue resolution, Situations where LLM accuracy remains inconsistent.
* **Enterprise Control Requirements**: When customers require strict separation between automated and manual scoring, or when organizations need to isolate certain metrics from AI analytics.

## Configure By Manual Evaluation Metrics

1. Navigate to **Quality AI** > **Configure** > **Evaluation Forms** > **By Manual Evaluation Metrics**.
2. Select **+ New Evaluation Metrics**.
3. From the **Evaluation Metrics Measurement Type** dropdown, select **By Manual Evaluation**.\\

   <img src="https://mintcdn.com/koreai/bPimY2iX8wmlOa2o/ai-for-service/quality-ai/configure/evaluation-criteria/evaluation-metrics/images/manual-evaluation.png?fit=max&auto=format&n=bPimY2iX8wmlOa2o&q=85&s=eb6e4a888a689b1ae121d8afd1f45f97" alt="Configure New Metric" width="555" height="320" data-path="ai-for-service/quality-ai/configure/evaluation-criteria/evaluation-metrics/images/manual-evaluation.png" />

   <Note> You can add manual evaluation metrics only to Points-Based evaluation forms, not to **Percentage-Based** evaluation forms. For **Percentage-Based** evaluation forms, this metric type is disabled.</Note>
4. Enter a metric **Name** to identify the metric used for manual scoring.
5. Specify the evaluation **Question** that auditors review manually when they evaluate the interaction\\
   <img src="https://mintcdn.com/koreai/Pkc6d1F5L5NzUadG/ai-for-service/quality-ai/configure/evaluation-criteria/metrics-measurement-types/images/by-manual-evaluation-metric-details.png?fit=max&auto=format&n=Pkc6d1F5L5NzUadG&q=85&s=e106b6345fdb5e5d7002584ae1015c25" alt="Manual Evaluation Metrics" width="411" height="283" data-path="ai-for-service/quality-ai/configure/evaluation-criteria/metrics-measurement-types/images/by-manual-evaluation-metric-details.png" />
6. Select **Create** to save and activate the Dynamic By Question configured adherence metric.

   <Note> The system assigns metric weightage only in points, as Manual Evaluation metrics support only points-based scoring. Percentage-based scoring requires the total weight of all metrics to equal 100%, which QA Managers can’t maintain when an evaluation form includes both automated and manual metrics. </Note>
   Refer to the [Evaluation Forms](/ai-for-service/quality-ai/configure/evaluation-forms) for details on the manual scoring process.

## Managing Evaluation Metrics

### Edit or Delete Evaluation Metrics

Steps to edit or delete existing Evaluation Metrics:

1. Select any of the existing **By Manual Evaluation Metrics**.
2. Select **Edit** to update the required metric fields.
3. Select **Delete** to remove the selected metric.
4. Select **Update** to save the changes.

To view manually evaluated interactions and manual evaluation metrics, see [Conversation Mining-Interactions](/ai-for-service/quality-ai/analyze/conversation-mining-interactions) and [AI-Assisted Manual Audit](/ai-for-service/quality-ai/analyze/ai-assisted-manual-audit).
