Tensor2Tensor is an open-source system for training deep learning models in TensorFlow. It facilitates the creation of state-of-the art models for a wide variety of ML applications, such as translation, parsing and image captioning enabling the exploration of various ideas much faster than previously possible.