Technology term
Mixture of Experts (MoE)
A machine-learning architecture made of multiple specialized subnetworks, called experts, and a routing mechanism that selects which experts process each input. Activating only part of the model can increase capacity without using every parameter for every request.
English
Mixture of Experts
Arabic
بنية مزيج الخبراء
First appeared in
China’s Kimi K3 Just Shook the AI Race, but Its 2.8 Trillion Parameters Come With a Catch
