What is Mixture of Experts (MoE)?

A machine learning technique where different specialized sub-networks (experts) are used for different parts of an input.