Technology term
Data Parallelism
A distributed training technique in which multiple processors hold copies of the same model, process different portions of a batch, and combine their gradients to update shared parameters.
English
Data Parallelism
Arabic
توازي البيانات
First appeared in
CluSTER Cuts AI Fine-Tuning Time by Choosing What Each GPU Learns
