Qualitative Metrics

AI Metrics that Matter:

Quantitative metrics are objective, numerical measures used to evaluate specific attributes of a system or process. They provide clear, reproducible, and data-driven evaluations that are typically calculated using mathematical formulas or statistical methods. These metrics are objective, meaning they provide consistent results independent of individual interpretation. Results are expressed in numbers, percentages, or ratios and the metrics can be calculated using algorithms without human intervention.

• BLEU
  • Traditional metric for translation
• ROUGE
  • Traditional metric for **summarization
• Perplexity
  • Measures how certain the model is by its output
• METEOR
  • Metric is used to evaluate various NLP tasks, such as machine translation, summarization, and other generative AI applications
  • METEOR: An Automatic Metric for MT Evaluation