Glossary

ROC curve

What is ROC curve?

The ROC curve (receiver operating characteristic) shows how well a classification model separates two classes. For every possible decision threshold it plots the true positive rate (recall) against the false positive rate. The closer the curve reaches towards the top-left corner, the better; the diagonal corresponds to pure guessing. The area under it (AUC) summarises the curve in a single number and helps, for example, when comparing different fraud detection models.

Topics

  • metric
  • model evaluation
  • classification

Try KI.ordo

Agents, flows and templates in one workspace – free 24-hour demo.

Start demo
← All terms

Related terms

Area under the curve (AUC)

The area under the curve (AUC) is a metric for classification models, usually referring to the ROC curve. It indicates how well a model separates positive from negative cases, independently of any particular threshold. A value of 1 means perfect separation; 0.5 is no better than guessing. Example: a churn model with an AUC of 0.85 ranks a randomly chosen customer who leaves as riskier than a loyal one in 85% of cases.

  • Evaluation metric
  • ROC
  • +1

Recall in machine learning

Recall (also called sensitivity or true positive rate) measures what share of the actual positive cases a model detects: correctly identified positives divided by all real positives. If a fraud filter catches 80 out of 100 real fraud cases, its recall is 0.8. High recall matters when missed cases are costly, such as in medical diagnosis. Because it ignores false alarms, it is usually considered together with precision, for example in the F-score.

  • metric
  • model evaluation
  • +1

Confusion Matrix

A confusion matrix is a table that compares a classifier's predictions with the actual classes. For two classes, it shows true positives, false positives, true negatives and false negatives. From this, metrics such as precision, recall and F1 score can be calculated, and it becomes clear which errors occur. Example: a spam filter that flags many genuine emails as spam has many false positives, which is often more costly than a missed spam message.

  • Model evaluation
  • Classification
  • +1

Classifier

A classifier is a model or method that assigns inputs to one of several predefined categories. Classic variants such as decision trees or naive Bayes are trained on labelled examples; language models can also sort texts based on a description of the categories. Typical uses include spam detection, sorting customer enquiries by topic and categorising receipts. Quality is measured with metrics such as accuracy, precision and recall.

  • Classification
  • Machine learning
  • +1
Template