Deep learning is a branch of machine learning that uses artificial neural networks with many layers. Such networks learn from large amounts of data which features matter – from edges in images to relationships of meaning in texts. Deep learning underpins today's language models, image and speech recognition and machine translation, and usually requires considerable computing power and training data.
Artificial neural networks (ANNs) are computational models made up of many connected units (“neurons”) arranged in layers that process inputs via weighted connections. During training, the weights are adjusted step by step using examples, usually by backpropagation. ANNs are the foundation of deep learning and power image recognition, speech recognition and large language models. Despite their biological inspiration, they work far more simply than the human brain.
Machine learning is a branch of artificial intelligence in which computers derive patterns from data instead of having every rule explicitly programmed. Depending on the task, models learn from labelled examples (supervised), from unlabelled data (unsupervised) or through rewards (reinforcement). Applications range from spam filters and demand forecasts to product recommendations. Quality depends heavily on the quantity and quality of the training data.
A convolutional neural network (CNN) is a neural network architecture particularly suited to image data. It scans the input with small filters, detecting simple features such as edges in the first layers and more complex shapes in deeper ones. CNNs shaped image recognition for many years and are used, for example, to spot defects in product photos or in medical image analysis.
The transformer is a neural network architecture introduced in 2017 in the research paper “Attention Is All You Need”. At its core is the attention mechanism: each word is weighted in relation to all other words in a text, and the computation can be parallelised efficiently. Transformers underpin today's language models such as GPT, Claude and BERT and are also used for images and audio.
