GLOSSARY TERM

What is Batch Normalization?

A technique to stabilize and accelerate training by normalizing layer inputs.
Batch normalization standardizes the inputs to a layer for each mini-batch, reducing internal covariate shift. This allows for higher learning rates, less sensitivity to initialization, and acts as a mild form of regularization.

Stable Model Training

Accelerate your model convergence with TacTech's optimized training pipelines.