Ai Tools Research
Ctrlk
  • Group 1
  • 🔲About Ai Tools Research
  • 🔲LARGE LANGUAGE MODELS (LLM's)
  • Blockchain & AI
  • Ai Tools Main Categories
    • 🔲TEXT & WRITING
    • 🔲AUDIO, SPEECH & MUSIC
    • 🔲VIDEO & ANIMATION
    • 🔲IMAGES, ART & DESIGN
    • 🔲PROGRAMMING & CODE
    • 🟢Prompt Design and Engineering
    • 🔲AI RESOURCES
    • 🔲AI HARDWARE (GPU's & TPU's) and Cloud Services
    • 🔲OTHER
  • 🔲SOLUTIONS & TUTORIALS
  • 🔲AI TECHNOLOGY
    • 𝐀𝐈 𝐀𝐥𝐠𝐨𝐫𝐢𝐭𝐡𝐦𝐬 𝐒𝐢𝐦𝐩𝐥𝐢𝐟𝐢𝐞𝐝
    • Foundation Models
    • Artificial Neural Networks (ANN's)
    • ANN Deep Learning Architectures
      • 1. Feed-Forward Neural Networks (FFNs)
      • 2. Recurrent Neural Networks (RNNs)
      • 3. Transformers
        • a) Transformer (Base Model)
        • b) BERT (Bidirectional Encoder Representations from Transformers)
        • c) GPT (Generative Pretrained Transformer)
        • d) T5 (Text-to-Text Transfer Transformer)
        • e) BART (Bidirectional and Auto-Regressive Transformers)
        • f) RoBERTa, ALBERT, DistilBERT
    • Generative Ai Architectures & Models
    • Zero-Shot Video Generation
    • Symbolic Reasoning AI
    • Neuro-Symbolic AI
    • Vision Transformer (ViT)
  • 🔲GLOSSARY OF AI TERMS
Powered by GitBook
On this page
  1. 🔲AI TECHNOLOGY
  2. ANN Deep Learning Architectures
  3. 3. Transformers

a) Transformer (Base Model)

Previous3. TransformersNextb) BERT (Bidirectional Encoder Representations from Transformers)

Last updated 2 years ago