November 22, 2021 Announcing Tutel, an efficient mixture-of-experts implementation for large deep neural network model training