Reformer, the efficient Transformer, in Pytorch. Contribute to lucidrains/reformer-pytorch development by creating an account on GitHub.

DeepFill v1/v2 with Contextual Attention and Gated Convolution, CVPR 2018, and ICCV 2019 Oral - JiahuiYu/generative_inpainting

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute - lucidrains/lambda-networks

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included...

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch - lucidrains/vit-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch - lucidrains/DALLE-pytorch

A concise but complete full-attention transformer with a set of promising experimental features from various papers - lucidrains/x-transformers

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐ - xmu-xiaoma666/External-Attention-pytorch

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites - cmhungsteve/Awesome-Transformer-Attention

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch - lucidrains/make-a-video-pytorch