Metrics Reference¶
Retrieval Metrics¶
Recall@k¶
Fraction of relevant documents retrieved in top-k. Recall@k = |relevant in top-k| / |total relevant|
MRR (Mean Reciprocal Rank)¶
Average reciprocal rank of first relevant document. MRR = 1/|Q| * sum(1/rank_i)
NDCG@k (Normalized Discounted Cumulative Gain)¶
Ranking quality metric penalizing relevant docs appearing lower.
Generation Metrics (1-5 scale)¶
| Metric | Description |
|---|---|
faithfulness |
Factual accuracy vs. source material |
relevance |
How well the answer addresses the question |
completeness |
Whether all aspects are covered |
overall |
Weighted combination |
Thresholds¶
| Threshold | Badge Color |
|---|---|
| >= 0.90 | Green #9ece6a |
| >= 0.80 | Yellow #e0af68 |
| < 0.80 | Red #f7768e |