HOME
ABOUT
DEVBLOG
DISCORD
Written
and directed
Dmytro
Ishchenko
Oleksii
Ishchenko
Based
Kyiv, Ukraine
For any questions
and ideas
please contact us
[email protected]
Kudos to these guys for their awesome game assets
ansimuz
edermunizz
Pixray images are generated by
Pixray
Several music tracks from
Jonathan Segev
Some images
Cat
Dog
by Vecteezy
and
Flaticon
Research papers used
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin, 2017;
arXiv:1706.03762
Attention Is All You Need
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, 2018;
arXiv:1810.04805
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, ... Dario Amodei, 2013;
arXiv:1308.0850
Language Models are Few-Shot Learners
Alex Graves, 2013;
arXiv:1308.0850
Generating Sequences With Recurrent Neural Networks
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, 2021;
arXiv:2106.09685
LoRA: Low-Rank Adaptation of Large Language Models
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, ... Guillaume Lample, 2023;
arXiv:2302.13971
LLaMA: Open and Efficient Foundation Language Models
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang, 2016;
arXiv:1606.05250
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, ... Thomas Scialom, 2023;
arXiv:2307.09288
Foundation and Fine-Tuned Chat Models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, Björn Ommer, 2021;
arXiv:2112.10752
High-Resolution Image Synthesis with Latent Diffusion Models
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, ... Alexander M. Rush, 2019;
arXiv:1910.03771
HuggingFace's Transformers: State-of-the-art Natural Language Processing