AI Glossary
Accuracy
Accuracy measures how often an AI model makes correct predictions compared to the total number of predictions it makes.
Overview
When people first begin learning about AI, accuracy is often the first performance metric they encounter.
The idea seems straightforward.
If a model makes correct predictions most of the time, it must be performing well.
In many situations, this is true.
Accuracy measures the percentage of predictions that are correct.
For example, if a model makes 100 predictions and correctly predicts 90 of them, its accuracy is 90%.
However, this is where many people become confused.
Accuracy does not always tell the full story.
Imagine a fraud detection system where only 1% of transactions are fraudulent. A model that labels every transaction as legitimate would achieve 99% accuracy while completely failing to detect fraud.
This example highlights an important lesson in machine learning.
A model can appear highly accurate while still performing poorly on the task that matters most.
Because of this, AI practitioners often combine accuracy with other metrics such as precision, recall, and F1 score to gain a more complete understanding of model performance.
Why It Matters
Accuracy provides a simple way to measure model performance, but it should be interpreted within the broader context of the problem being solved.
Real-World Example
An email spam filter correctly classifies 950 out of 1,000 messages, giving it an accuracy score of 95%.
Related Concepts
- Model Evaluation
- Precision
- Recall
- F1 Score
- Cross Validation