#python #artificial_intelligence #attention_mechanism #machine_learning #pytorch #transformers

https://github.com/lucidrains/reformer-pytorch

#python #attention_model #deep_neural_networks #deepfill #generative_adversarial_network #image_inpainting #tensorflow

https://github.com/JiahuiYu/generative_inpainting

#python #artificial_intelligence #attention #attention_mechanism #computer_vision #deep_learning

https://github.com/lucidrains/lambda-networks

#python #attention #attention_is_all_you_need #attention_mechanism #deep_learning #deeplearning #jupyter #original_transformer #pytorch #pytorch_transformer #pytorch_transformers #transformer #transformer_tutorial #transformers

https://github.com/gordicaleksa/pytorch-original-transformer

#python #artificial_intelligence #attention_mechanism #computer_vision #image_classification #transformers

https://github.com/lucidrains/vit-pytorch

#python #artificial_intelligence #attention_mechanism #deep_learning #multi_modal #text_to_image #transformers

https://github.com/lucidrains/DALLE-pytorch

#python #deep_learning #transformers #artificial_intelligence #attention_mechanism

https://github.com/lucidrains/x-transformers

#python #attention #cbam #excitation_networks #linear_layers #paper #pytorch #squeeze #visual_tasks

https://github.com/xmu-xiaoma666/External-Attention-pytorch

#other #attention_mechanism #attention_mechanisms #awesome_list #computer_vision #deep_learning #detr #papers #self_attention #transformer #transformer_architecture #transformer_awesome #transformer_cv #transformer_models #transformer_with_cv #transformers #vision_transformer #visual_transformer #vit

https://github.com/cmhungsteve/Awesome-Transformer-Attention

#python #artificial_intelligence #attention_mechanisms #axial_convolutions #deep_learning #text_to_video

https://github.com/lucidrains/make-a-video-pytorch

#python #artificial_intelligence #attention_mechanisms #deep_learning #human_feedback #reinforcement_learning #transformers

https://github.com/lucidrains/PaLM-rlhf-pytorch

#python #artificial_intelligence #attention_mechanisms #audio_synthesis #deep_learning #transformers

https://github.com/lucidrains/audiolm-pytorch

#python #attention_mechanism #deep_learning #gpt #gpt_2 #gpt_3 #language_model #linear_attention #lstm #pytorch #rnn #rwkv #transformer #transformers

https://github.com/BlinkDL/RWKV-LM

#cplusplus #4_bits #attention_sink #chatbot #chatpdf #intel_optimized_llamacpp #large_language_model #llm_cpu #llm_inference #smoothquant #sparsegpt #speculative_decoding #stable_diffusion #streamingllm

https://github.com/intel/intel-extension-for-transformers

#python #attention #dataset #pytorch #transformer

https://github.com/hyunwoongko/transformer

#python #artificial_intelligence #attention_mechanism #deep_learning #transformers

The `x-transformers` library offers a versatile and feature-rich implementation of transformer models, allowing users to easily build and customize various types of transformers. Here are the key benefits You can create full encoder/decoder models, decoder-only (GPT-like) models, encoder-only (BERT-like) models, and even image classification and image-to-caption models.
- **Experimental Features** You can customize layers with various normalization techniques (e.g., RMSNorm, ScaleNorm), attention variants (e.g., Talking-Heads, One Write-Head), and other enhancements like residual attention and gated feedforward networks.
- **Efficiency** The library provides simple wrappers for autoregressive models, continuous embeddings, and other specialized tasks, making it easier to set up and train complex models.

Overall, `x-transformers` simplifies the process of building advanced transformer models while offering a wide range of customization options to improve performance and efficiency.

https://github.com/lucidrains/x-transformers