A paper introducing the Transformer, a neural network architecture built solely on attention mechanisms to replace recurrence and convolution for machine translation. It shows state-of-the-art BLEU scores on WMT tasks and highlights improved parallelization and training efficiency.

Neural Information Processing Systems http://nips.cc/

Attention is All you Need