The term "backpropagation" belongs to the context of Artificial Intelligence, more precisely: It refers to neural networks. It is a method that is used for training neural networks. In neural networks, signals are passed between artificial neurons. Information (pictures, text, etc.) is received by neurons from the input layer, then signals pass through the Neural Network until the output layer. Each neuron processes specific information, evaluates it and transmits a signal to the next artificial neuron. If an artificial neuron passes on a signal, we say: a neuron “fires”.

For a neural network to recognize a cat as such on an image, all relevant image information must be processed in such a way that the output cell ejects the result "cat". Let me use a simple metaphor: If several dozens of neurons each make a probability statement whether the image element processed by them belongs to a cat or not (eye, ear, tail, coat pattern, etc.), then you’ll have a probability statement at the end. An artificial neuron makes this statement by passing on a signal with a certain signal strength. At the same time, the incoming signals must be correctly "weighted". Each incoming signal of an artificial neuron has a "weighting" of its own.

The training of a neural network is basically about adjusting these "weightings". If the expected result is not achieved, the weighting must be adjusted. This is done by calculating for each weighting the "responsibility" it has in causing the deviation between expected results and actual result. These deltas are used to adjust the weights.

Author

Sebastian Zang has cultivated a distinguished career in the IT industry, leading a wide range of software initiatives with a strong emphasis on automation and corporate growth. In his current role as Vice President Partners & Alliances at Beta Systems Software AG, he draws on his extensive expertise to spearhead global technological innovation. A graduate of Universität Passau, Sebastian brings a wealth of international experience, having worked across diverse markets and industries. In addition to his technical acumen, he is widely recognized for his thought leadership in areas such as automation, artificial intelligence, and business strategy.