Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin, 2017; arXiv:1706.03762

Attention Is All You Need

Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, 2018; arXiv:1810.04805

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, ... Dario Amodei, 2013; arXiv:1308.0850

Language Models are Few-Shot Learners

Alex Graves, 2013; arXiv:1308.0850

Generating Sequences With Recurrent Neural Networks

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, 2021; arXiv:2106.09685

LoRA: Low-Rank Adaptation of Large Language Models

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, ... Guillaume Lample, 2023; arXiv:2302.13971

LLaMA: Open and Efficient Foundation Language Models

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang, 2016; arXiv:1606.05250

SQuAD: 100,000+ Questions for Machine Comprehension of Text

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, ... Thomas Scialom, 2023; arXiv:2307.09288

Foundation and Fine-Tuned Chat Models

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, Björn Ommer, 2021; arXiv:2112.10752

High-Resolution Image Synthesis with Latent Diffusion Models

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, ... Alexander M. Rush, 2019; arXiv:1910.03771

HuggingFace's Transformers: State-of-the-art Natural Language Processing