A transformer model is a neural network architecture that can automatically transform one type of input into another type of output. The term was coined in the 2017 Google paper titled "Attention Is ...