AI Glossary

Self-Supervised Learning

Self-supervised learning is a machine learning technique where AI creates its own learning tasks from unlabeled data.

Overview

Self-supervised learning allows models to learn useful patterns from massive datasets without requiring human-created labels.

Many modern foundation models and large language models use self-supervised learning during training.

Self-supervised learning enables AI systems to learn from enormous amounts of information found across the internet and other sources.

This approach has become a major factor behind recent advances in generative AI.

Large language models learning language patterns by predicting missing words in billions of text documents.