Ai Tools Research
  • 🔲About Ai Tools Research
    • AI Adoption Consultation & Training Services
      • Build an Ethical Platform for AI
      • Corporate AI Safety Guidance
        • Why AI ethics?
        • Principle of Discriminatory Non-Harm
      • Training Services
        • Training Courses
          • The Full Applied GenAI Curriculum
          • Gemini Training Courses
        • Corpus Creator
    • LLM Performance Benchmarks
      • LLM Benchmarks Master List
        • LLM Benchmark Categories
      • Size, Quality and Cost of Training Data in LLM’s
      • LLM Benchmarks and Tasks
        • Chatbot Arena
          • How to use ChatBot Battle Arena
        • LLM Capabilities Test
        • Benchmarking of Large Language Models
        • F1 score (F-measure one)
        • Foundation Model Transparency Index
        • TriviaQA (5-Shot)
        • QuALITY (5-Shot)
        • Codex P@1 (0-Shot)
        • RACE-H (5-Shot)
        • ARC-Challenge (5-Shot)
        • GSM8k (0-Shot CoT)
        • MMLU (Massive Multitask Language Understanding)
          • MMLU (5-Shot CoT)
          • MMLU
        • SOTA in Artificial Intelligence
        • Context Window Size
      • Alpaca 2.0 Evall
    • Youtube Videos Directory
      • T981g - Post AGI Economics
        • Post-AGI Economics (Part 1)
        • Post-AGI Economics (Part 2)
      • T981m - Path to AGI -Debates, Definitions, and the Future Ahead
      • AI Explained: Tracing Intelligence from Mammals to Machines
      • Artificial Super Intelligence (ASI)
      • The Path From AI to ASI
        • T701 - The Stages of AI Evolution Final
        • T703 - A Decentralized Path to AGI and ASI
        • What is Artificial Intelligence (Ai) and what are Ai Neural Networks
      • AI Trends of Next Two Years
      • AI in Programming: Threat to Jobs or a Tool for Enhancement?
    • Frequently Asked Questions (FAQs)
      • A Typology of AI
        • AI Taxonomy
        • Difference between Symbolic Language and Natural Language
      • Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs) and Diffusion Models
      • What is 'Latent Space' in Image Generation?
      • What is LoRA and How does LoRA work
      • What is Gradient Descent?
      • Page 1
      • What is 'Inpainting' & 'Outpainting' ?
      • What is 'DPO' in LLM Training?
      • What is 'One-Shot' Learning?
      • FAQs on LLM Training and Data Labelling
        • LLMs Main Concepts Explained
        • LLM Evaluation
        • Building Datasets
          • Kili Technology
          • Text Annotation
          • SmartOne Data Labeling Services
        • What is an 'Uncensored LLM'
          • Open Source AI Will Outcompete Google and OpenAI
        • What are Parameters in LLMs?
        • Parameters vs Tokens in LLMs?
        • What are Model Weights?
        • What is 'Inference Cost'?
        • Training Corpus and Datasets
          • Open-Sourced Training Datasets for LLMs
          • Datasets List from Dr. Alan Thompson
          • Corpus Used by Large Language Models (LLMs) for Different Applications
        • What are 'Tokens' ?
        • What are Token Limits?
        • What Are Context Windows?
          • Is 'Context Window' and 'Token Limit' the same?
          • LLM with Largest Context Window?
          • Tokens, Words and Pages
        • How to Fine Tune LLMs?
        • Case Study of Fine-Tuning an LLM
          • How to'Tokenize' the data?
          • What are OOV Tokens?
          • Arrays and Tensors
            • Difference between Numpy and TensorFlow
            • NumPy or TensorFlow?
          • Setting Training Parameters
          • Do you need to adjust Model Weights during training?
          • Why do some models have 'Open Weights' and others 'Closed Weights'?
          • Inference Parameters vs. Training Parameters
          • AutoTrain LLMs at HuggingFace
            • 'TheBloke' at Huggingface?
            • What are GGUF Format Model Files?
            • What does 'Mistral 7B quantized in 4-bit with AutoAWQ' mean?
            • What does a 'Quantized Version' of an LLM mean?
        • What is "RAG," (Retrieval-Augmented Generation)?
          • 𝐑𝐀𝐆 𝐅𝐫𝐨𝐦 𝐒𝐜𝐫𝐚𝐭𝐜𝐡
        • What does "Release Base, Instruct and Reward Model" mean?
    • Articles and Transcripts
      • Fine Tuning LLMs for Use Cases
        • Fine Tuning for Risk Mgmt.
        • LoRA - Low-Rank Adaptation
      • Natural Language Processing Guides
        • Basic Guide-Natural Language Processing (NLP)
        • Comprehensive Guide to NLP [2023 Edition]
      • SLM's vs. LLM's
      • Python Tools
        • API Protocols
        • Top Python Libraries and Frameworks for Various Domains
        • 5 Layers of Software Development
        • LM Studio -Open Source LLM Installer
          • LM Studio
        • Chainlit.io
      • Deploying LLMs on Local Machine
        • Microsoft AutoGen Studio
        • Ollama
        • Gradio Web UI for LLMs
        • Pinokio -Install and Run Servers & AI Apps
      • LLM Use Case and Fine-Tuning and Training Costs
      • How to Build a LLM from Scratch
        • 1. Evaluate Financial Costs involved
        • 2. Data Curation
          • GPT-4 Tokens
        • 3. Model Architecture
        • 4. Training the Model at Scale
        • 5. Evaluating the Model
      • Databases and LLMs
        • Database-Mind
  • 🔲LARGE LANGUAGE MODELS (LLM's)
    • GOOGLE Gemini
      • Bard (Google)
      • Gemini 1.0
      • Gemini Advanced
    • META
      • LlaMA-3
      • Chameleon: Mixed-Modal Early-Fusion Foundation Models
    • Claude (Anthropic)
      • Claude 2 Parameters
    • Earnie AI (Baidu)
    • Microsoft
      • Bing Chat (Microsoft)
    • DeepMind
      • Personal AI (Pi)
    • OpenAI
      • ChatGPT-4 (OpenAi)
        • Is GPT-4 Open Source?
        • ChatGPT can now See, Hear, and Speak
      • ChatGPT-4 Turbo, Custom GPTs and AI Agents
    • Open Source LLMs
      • Open Source Image Models
        • Florence-2: Vision foundation model (Microsoft)
        • Würstchen: Fast Diffusion for Image Generation
        • Omni-Zero
      • Snowflake Arctic 128 Experts MoE
      • Mistral 7B
        • Mistral 7B Installation on Windows Locally
        • Mistral 7B Model Card-V0.1
        • Inference Parameters for Mistral 7B
      • Mixtral 8X-7B
        • Installing Mixtral 8X-7B
      • Llama 2 (Meta)
        • Installing and Using Llama 2 Locally
      • FALCON LLM
        • Deploy FALCON-180B Instantly
      • LLaVA 1.5
        • LLaVA 1.5: Best Open Source Alternative To GPT-4V
      • BLOOM
      • MPT-7B
      • Vicuna-13B
      • X-Ai's Grok
      • Qwen 2, 72B
      • DBRX (DataBricks)
      • Nemotron-4, 340B (NVidia)
        • Moshi by Kyutai
        • Performance Benchmarks
        • Nemotron 340B, Training Data
      • Florence2
  • Ai Tools Main Categories
    • 🔲TEXT & WRITING
      • Copywriting
        • Jasper
        • Rytr
        • Copy.ai
        • AI Writer
        • ShortlyAI
        • Article Forge
        • ClosersCopy
        • Typewise
        • Grammarly
        • DeepAI
        • Wordtune
      • Scriptwriting & Screenwriting
        • Celtx
        • AiScreenwriter
        • WriterDuet
        • Boords
        • StudioBinder
          • Guide to Scriptwriting
          • StudioBinder - Video
      • Story Teller / Story Writing
        • Quillbot
        • Sassbook
        • Authors.ai
        • Novel AI
        • Headlime
        • Simplified AI
        • DeepStory
        • Sudowrite
        • Compose AI (Facebook)
        • HyperWrite
        • AI Dungeon
        • Inkforall
        • Bramework
        • Plot Generator
        • StoryLab.ai
        • Charisma
        • InferKit
      • Storyboarding Tools
        • Storyboarder by Wonder Unit
        • Storyboard That
        • Krock.io (Storyboard AI)
          • Krock.io Tutorials
        • StoryboardHero AI
          • How StoryboardHero AI Works
        • FrameForge
      • Other General AI Text Tools
        • Paraphraser
        • Summarizing Tools
        • Language Translation
        • Email Assistants
          • Gappsy
      • AI Personal Assistants
        • TextCortex AI Assistant
    • 🔲AUDIO, SPEECH & MUSIC
      • SonicVisionLM
      • Text to Speech (TTS)
        • Murf AI
        • RunwayML Text-to-Speech
        • Speechify
        • Natural Readers.com
        • ElevenLabs - Prime Voice
        • ChatTTS
        • Google Text-to-Speech
        • Narakeet
          • The Narakeet story
        • Uberduck
        • TTS Technologies
      • Audio Editing
        • Audicity
      • Voice Changers / Cloners
        • Preventing the Harms of AI-enabled Voice Cloning
        • Metavoice Voice Changer
        • * OpenVoice: Open Source Voice Cloning
        • MARS5 TTS
        • RVC WebUI
          • Tutorial on How to Use RVC WebUI
        • Tortoise TTS (Text to Speech & Cloning)
          • Tutorial on How to Clone a Voice using Tortoise-TTS
        • Voice.ai
      • Video & Audio Transcription and Translation
        • Otter.ai
        • Cockatoo
        • AURIS Speech to Text
        • Whisper AI (OpenAI)
          • Command Line usage
          • Languages
          • Model Card of Whisper
        • Rask AI
        • Meta Speech-to-Speech Translation
        • Maestro AI
      • Music Generation
        • Musical Genres, Vibes and Themes
          • Musical genres
          • Most Popular Themes In Songs
          • The 13 moods of music?
        • AIVA Music Composer
        • Suno.Ai
        • Udio
        • Stable Audio
        • Google MusicFX
        • AudioCraft (Meta/Facebook)
          • Installing Audiocraft
          • How To Install Audiocraft Locally
        • Audio Cleanup - Noise Removal
          • Goyo -AI Noise Reduction Plugin
          • Goyo vs ClarityVX Audio Clean Up- comparion
        • Other AI Music Tools
      • Descript
      • Lip Sync & Animated Avatars
        • Lip-Sync Articles & Resources
          • Wav2Lip Alternatives and (Jun 2023)
          • Top 10 Best Lip Sync Apps - June 2023
          • Five Lip-Sync Tools
          • 60 Best Lip Synching AI Tools
        • Hallo Portrait Animation
        • Hedra’s Character-1
        • Wav2Lip
        • AniPortrait
          • AniPortrait Tuturials
        • LivePortrait
          • LivePortrait Tutorials
        • ReadyPlayerMe (3D Models only)
        • Sync Labs (Wav2Lip compatible)
        • Lalamu Studio
          • Notes/Observations
        • TokkingHeads LipSync
        • DupDub Ai
        • D-ID
          • Notes/Comments
        • DeepFacelive
        • EMO: Emote Portrait Alive (AliBaba)
          • Lipsync AI by Emotech (3D Models Only)
        • VASA-1, AI Face Animator (Microsoft)
    • 🔲VIDEO & ANIMATION
      • Video Synthesis (Generation)
        • Top AI Video Synthesis Tools (2024)
        • Google Video
          • MAGVIT (Google)
          • Video Poet (Google)
          • Lumiere
        • Alibaba Research Lab
          • EMO: Emote Portrait Alive
          • MaTe3D
          • VividTalk
          • Outfit Anyone
          • Cloth2Tex
        • Meta
          • Make-A-Video
          • Emu Video tools
        • Apple
          • Matr-yoshka Diffusion Models (MDM)
        • Kaiber.ai
          • AI Technology used by Kaiber
          • Kaiber Tutorials
        • ⭐Runway ML
          • Technology used by Runway
          • Pricing Plans
          • Runway AI vs Pika Labs
        • Modelscope
        • ZeroScope
        • Deforum
          • Technology used by Deforum
          • How-To Videos
        • Neural Frames AI
        • ⭐Pika Labs
          • AI Technology used by Pika Labs
          • Tutorials
            • Pika Labs Motion Aware Text2Video
            • Mastering Pika 1.0
            • Pika 1.0 First Look
            • Extending Pika.AI Video Duration
        • Genmo.Ai
        • Moonvalley
        • ⭐Morph Studio - Stability AI
        • LensGo AI
          • LensGo Tutorials
        • Stable Diffusion Video
          • Stable Diffusion Video Tutorial
        • i2vGen-XL (Image to Video)
        • PromeAI
        • Assistive Video
          • Assistive Video Review
          • Assistive Video API
        • ⭐PixVerse
          • PixVerse - Next-Gen AI Video Synthesis
        • DomoAI Video Transformation
        • Artflow.ai
          • Does Artflow.Ai use LoRA to train their Models?
          • Tutorial
        • Boximator
        • AI Animation
          • Sketch.metademo
          • MagicAnimate
        • ⭐LTX Studio
          • LTX Studio Tutorial
        • ⭐Haiper AI
        • ⭐Luma Dream Machine
        • ⭐Kling.Ai
        • ⭐SORA (OpenAI)
          • SORA Technical Explanation
        • ⭐Vivago.ai
      • Video Production & Editing
        • Visla AI
        • Colossyan Creator
        • HeyGen
        • Lumen5
        • Magisto / Vimeo
        • Pictory
        • Fliki.ai
          • Fliki Review: Is it Worth it?
          • Fliki Features
        • VEED
        • AI Studios
        • Kreado.Ai
          • Ai Talking Photos
        • Synthesia
          • Synthesia AI Neural Networks for training data for Avatars
          • Review of Synthesia
          • Nvidia-backed Synthesia
        • InVideo
        • Wondershare Filmora
        • Wondershare VIBRO.AI
          • Create Realistic Ai Avatar
          • Company Information
          • Pricing
        • Clipchamp (Microsoft)
          • Auto-captions
        • DaVinci Resolve
        • Canva Video Editing
          • Canva Graphic Design
          • Using Canva
        • CapCut
        • Cloudinary
        • Neiro.Ai
        • Opus Clip
        • DupDub.ai
          • DupDup Avatars
        • Genny by LOVO
        • Descript
      • Video Enhancement & VFX
        • Topaz Video AI
        • Pixop Video Upscaler
        • Wonder Studio VFX
          • Pricing and Addition Info
        • HitPaw Video Encoder
        • Adobe Firefly
        • Vmake AI
      • 3D Asset Creation Generative AI Tools
        • Meshy Text-to-3D
        • PIFuHD
        • Sloyd.ai
        • Google DreamFusion
        • Masterpiece Studio
        • Gepetto.ai
        • Get3D by Nvidia
        • Instant NeRF (Nvidia)
        • Point-E
        • 3DFY.ai
        • Stable Diffusion for Blender
        • Reallusion Platform for Character Creators
          • iClone 8 (IC8)
          • Character Creator (CC)
          • Cartoon Animator
          • ActorCore
        • Character Creator 3
        • HeroMachine
        • Picrew
        • Storior
        • Genie 3D (Luma Labs 3D Model)
          • How to use Luma Genie 3D
        • Avatars
          • BHuman.Ai
            • BHuman.Ai Tutorials
      • 3D Virtual Worlds
        • Spline AI
        • Blockade Labs Skybox
      • Objects,Scenes & MoCap to 3D and Animation
        • Wist
        • Luma AI
        • DeepMotion Animate 3D
        • Wonder Animation
    • 🔲IMAGES, ART & DESIGN
      • Image Generation
        • Ideogram.Ai
          • Ideogram Tutorial
        • Microsoft Bing Image Creator
        • Imagen (Google)
        • ImgCreator.Ai
        • Playground.ai
        • Stable Diffusion
          • Stable Diffusion in Layman's Terms
          • Stable Diffusion and VAE
          • How-To Videos
        • RunDiffusion
        • Clipdrop by Stability.Ai
          • Full Clipdrop Toolkit
        • Invoke.ai
        • DreamStudio (StabilityAI)
        • Leonardo.Ai
        • DALL-E (OpenAI)
          • Biggest ChatGPT Update: DALL·E 3, Voice-Chat, Image Input!
        • Magnific Relight (OpenAI)
        • MidJourney
        • PicSi.ai / InsightFaceSwap
          • InsightFaceSwap
        • PicSo.ai
        • ArtSmart.ai
        • Lexica.art
        • CM3leon (Meta)
          • Meta CM3leon AI vs OpenAI Dall-E 2
        • Synthesys X
        • Starry AI
        • Blue Willow
        • DragGAN
        • NightCafe AI
        • Imagine AI Art Generator
        • EMU Image Generator (Meta)
          • EMU Image Generator News
        • Krea.AI (Pencil Sketch to Image)
          • Krea Prompts
        • SeaArt AI
        • Scenario
          • Create Consistent Characters
        • Fooocus
          • Fooocus - SDXL
          • Fooocus Training Videos
            • FaceSwap and Consistent Characters
            • Inpainting and Outpainting
            • LoRA's, Styles and Models
            • Features Tutorial
            • Fooocus Photorealistic Images
          • Fooocus Installation
            • Minimal Hardware Requirement
            • Installing Fooocus
              • Video on Fooocus
            • Default Models
            • Download
            • List of "Hidden" Tricks
            • Customization
            • All CMD Flags
            • Advanced Features
          • Running Fooocus
          • Fooocus FAQs
            • What is PyraCanny?
            • Fooocus - Face Swap
        • OmniZero for Zero-shot stylized Portrait
        • Artist
      • Image Editing Tools
        • Remove.bg
        • Adobe Photoshop with Generative AI
          • Generative AI Technologies and Models used by Adobe
          • AI Tools from Adobe for AI-Video
        • LeiaPix (Image to 3D Video)
        • Synthetik Studio Artist
        • Magnific Image Upscaler
          • Magnific.AI -vs Midjourney Upscaler Comparison
        • Photopea
        • Nero Studio AI
      • Design & Design Assistant
      • Adobe Firefly
    • 🔲PROGRAMMING & CODE
      • CODE Generators
        • GPT Pilot
        • Cursor IDE
          • Command K
          • Chat
          • Copilot++
          • @ Symbols
          • Codebase Answers
          • Docs
          • Auto-Debug
          • Fix Lints
        • AlphaDev (DeepMind)
        • AIDER
        • Locofy
        • Phind
          • Phind Technical Specs
        • GitHub Copilot
        • Tabnine
        • DeepCode
        • CodeT5
        • WPCode
        • Visual Studio IntelliCode
        • AlphaCode (DeepMind)
        • AskCodi
        • AIXcoder
        • PyCharm
        • ChatGPT (GPT-3/4)
        • Codiga
        • Smol Developer
        • Jedi
        • Cody (Sourcegraph)
        • Wing Python IDE Pro
        • Ponicode
        • Polycoder
        • DevOpsGPT
        • CodeWhisperer (Amazon)
      • Lanchain
      • VS Code - Source Code Editor
      • Low-Code/No-Code
      • Spreadsheets
      • Database Design and SQL Programming
      • Testing & QA
        • Diffblue Unit Tests for Java Apps
        • EvoSuite
    • 🟢Prompt Design and Engineering
      • IMAGE Prompts Guide
        • Image Types and Art Styles
          • Digital Art Styles
            • Digital Illustration
            • Sumic.mic
            • ArtStation
            • Minimalistic Line Art Drawing
            • Neotraditional Tattoo Design
            • Manga
            • Steampunk
          • Renowned Artists
            • Greg Rutkowski
            • Paul Zizka
            • Raffaello Ossola
            • Martin Wittfooth
            • Luigi Spano
            • Vladimir Kush
            • Martin Schoeller
            • Yoshiyuki Sadamoto
            • Yoko Taro
            • Tom Bagshaw
            • Yoshitaka Amano
            • Zdzislaw Beksinski
            • Boris Vallejo
            • Alphonse Mucha
            • Gustav Klimt
            • Hiro Oda
            • Michael Cheval
            • Tanvir Tamim
          • Art Terms you should be using in Generative Art
            • 20 Art Terms you Should be Using in Midjourney AI
            • Prompts Secrets: 20 Midjourney Art Styles to Make your AI images POP
            • 20 MORE Art Styles -More Magic Midjourney Prompts
            • 20 illustration art styles to try in Midjourney
        • Lighting and Ambience
        • Camera Instructions
        • Output Aspect Ratio
          • Complete List of Aspect Ratio's
        • Seeds, Weights, and Prompt Parameters
        • Negative Prompts
        • Help with Prompt Terms
          • Global illumination (GI) Scattering Glowing Shadows
          • Trending on Artstation, by artgerm
          • H.R Giger and Beksinski
          • Misato Katsuragi
          • Fractal Isometrics details Bioluminescence
          • Neo-noir
          • Ray tracing, ambient occlusion, txaa ssao, etc.
          • Prywinko Art
          • Studio Ghibli
          • Phrase - Visual Poetry by Yukisakura
          • Volumetric (3D Representation or Depth and Dimension)
          • Ray Tracing and Ray-Traced Lighting
          • Octane Render and Unreal Engine 5
          • Glibatree
      • IMAGE Models
        • IDEOGRAM Prompts
          • Logos
          • Banners for Social Media Pages
          • Oil Paintings
          • Fantasy
          • Posters
          • Abstract Patterns
          • Text Captions
            • Neon Lettering
            • Embroidery
          • Signs
          • Androids and Cyborgs
          • Illustrations
        • LEONARDO Prompt Guide
          • Ultimate Prompt Generating Machine
          • Male Portraits/Images
          • Female Portraits/Images
            • European Women
            • American Women
            • Elderly Women
            • Woman in stunning Thai dress
            • Beautifully designed dress adorned with golden embroidery
          • General Scenes
          • Illustrations and Creative
          • Patterns, Logos and Designs
          • Greco-Roman
          • Vikings
          • Historic Scenes
          • Islamic and Arabs
        • DALL-E3 Prompt Guide
          • Industrial Age Prompts
          • Vintage Images
          • Sci-Fi and Futuristic
            • Androids
            • Humanity in Year 2039
            • Gen-AI Revolution
              • Video Synthesis and Movie Making
              • Voice Synthesis and Cloning
            • Classrooms
            • On a Farm
            • In an Office
            • Sports
            • Festive Humans and Humanoids
          • Historic Characters and Scenes
            • Scientists
            • Mongols and Chinese
            • Greco Romans
            • Islamic History
            • Guru Nanak
          • Objects
      • TEXT Generation Prompts
        • Claude 3 Prompt Library
      • VIDEO Synthesis Prompts
        • Text to Video Prompt Techniques
        • Pixverse Examples
          • Cinematic wide angle view
          • Close-up shot
          • Image to Video Examples
        • Pika Labs Prompts
          • Pika Labs Negative Prompts
        • Runway 3
          • Page
        • Hotshot
      • IMAGE TO TEXT Prompts
        • CLIP Interrogator
        • img2prompt
        • Replicate (Image-to-Text)
      • Hallucinations in LLMs
      • Prompt Generators
        • Prompt GPTs
          • Humans and Humanoids
        • G-Prompter
        • PromptMoat
          • Blade Runner Blues
        • PromptPerfect
          • PromptPerfect Resources
        • Weloveai.ca
        • Creative fabrica
        • Dair AI Prompt Engineering Guide
        • Vercel.ai Prompt Engineering
        • Brex's Prompt Engineering Guide
        • PromptoMANIA
    • 🔲AI RESOURCES
      • Custom GPTs (Open Ai)
        • Find the perfect AI Tool or GPT for your use case.
        • OpenAi GPT Store
        • GPTs Directory
          • GPTs for Research
          • GPTs for Video
          • GPTs for Image Generation
      • Huggingface
        • Models
      • Stock Photos and Videos
        • WireStock
          • Wirestock.io news, Oct 2023
        • Envato Elements
      • Promising Projects
        • GPT4RoI
        • Simulon VFX Tool
        • IP Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models
        • ConceptLab Creative Generation Framework
        • Dual-Stream Diffusion Net (DSDN) for Text-to-Video Generation
        • CoDeF
        • 3D Gaussian Splatting for Real-Time Radiance Field Rendering
        • MotionGPT
        • PanoHead
        • Rerender A Video
        • Picsart-AI-Research
        • Point-E (Open AI)
        • MagicAvatar
        • MagicEdit
        • Würstchen: Fast Diffusion for Image Generation
        • Zero-1-to-3 (Image to 3D)
      • Replicate.com
      • Katonic Playground
      • Vercel AI SDK
      • Cool Apps
      • Upscaling / Super-Resolution
      • Decentralized LLM's
        • PETALS
        • TAO Bittensor
        • Zarqa - Neural-Symbolic LLM
      • Singularity Twin Protocol
        • Introduction
        • Why Twin Protocol is Critically Needed
        • Corporate Case for Twin Protocol
        • Market Overview
        • Main Target Market
        • Twin Product Details
        • Twin Technology
        • Proof of Concept
        • Sources of Revenue
        • Twin Wallet
        • Twin User Data Security
        • Twin Marketplace
        • Roadmap
        • Leadership Team
        • Twin Ecosystem Economy
        • Reference
      • AI Autonomous Agents
        • AutoGen
        • MicroGPT
        • JARVIS/HuggingGPT
        • AutoGPT
        • AgentGPT
        • Crew.ai
          • Crew.Ai Tutorials
        • MetaGPT
          • How To Install MetaGPT
        • SuperAGI
          • How To Install SuperAGI
        • Agent-LLM
        • PHOTONAI (Python API)
      • Learn Generative Ai Coding
      • AI News Sources and Channels
        • weloveai.ca
        • The Birth of AI Videos
        • AI Generative Art Tools
        • 7 Underrated AI tools no one knows.. yet
    • 🔲AI HARDWARE (GPU's & TPU's) and Cloud Services
      • Hardware Specs for Stable Diffusion SDXL
      • Nvidia GPU Hardware
        • NVIDIA H100 GPU
        • Nvidia GH200
      • Echo3D Cloud Platform
      • AMD GPU Hardware
      • Monster API
      • AWS Cloud9 IDE
      • AWS Bedrock
      • Google Vertex AI
    • 🔲OTHER
      • BUSINESS & ADMIN
        • Customer Service & Support
        • Finance & Accounting
        • Human Resources
        • Legal Assistant
        • Presentations
        • Productivity
          • Notion AI
        • Tools for Startup Businesses
        • Marketing & Sales
          • TubeBuddy
          • Search Engine Optimization (SEO)
          • Social Media
          • E-commerce
          • Sales
          • Advertising and Marketing
          • Email Marketing
          • Website Generation
            • LEIA AI Website Builder
            • Braidio
            • Relume AI Site Builder
            • Pineapple AI Website Builder
            • KLEAP AI Website Builder
            • Hocoos AI Website Builder
      • LIFESTYLE & ENTERTAINMENT
        • Fashion & Grooming
        • Real Estate
        • Fun Tools
          • DAISYS.Ai
        • Gaming
        • Gift Ideas
        • Healthcare
        • Life Assistant
        • Memory, Retention and Long-Term Recollection
        • Health and Fitness
        • Travel & Vacationing
        • Dating & Companionship
        • Religion
        • AI Meme
        • Heritage, Genealogy and Family History
          • MyHeritage
        • Productivity
          • Krock.ai
      • EDUCATION / INFORMATION
        • Education Assistant
        • Tutors and Mentors
        • AI Search (Curated Research & Comparative Analysis)
          • Perplexity AI
  • 🔲SOLUTIONS & TUTORIALS
    • ALL AI TOOLS IN ONE PLACE
      • 𝐀𝐈 𝐓𝐨𝐨𝐥𝐬 𝐅𝐨𝐫 𝐄𝐯𝐞𝐫𝐲 𝐏𝐮𝐫𝐩𝐨𝐬𝐞
    • Tools Selection
      • Reface AI
      • Akool AI Swap Face Tutorial
      • Adobe Express
      • DeepFaceLab
        • Pretrained Models
      • Face Swap
      • Clone Works AI studio
      • Wav2Lip (LipSync)
      • Lalamu Studio (LipSync)
      • ROOP (Deep Fake Video)
        • ROOP Tutorial
        • ROOP Installation
      • Dataset Tag Managers
        • Booru Dataset Tag Manager
          • Why is the Booru Dataset Tag Manager called 'Booru'?
        • Image Dataset Tag Editor
    • Installing Python
      • Code in Python using AI
    • Create a News Video Channel
    • Create Animations & Videos
      • AI Animation Generator - 3D Movie with AI
      • Create Animation Videos for Kids
      • Create Animated Video from a Single Image
      • Convert Video Into Animation
    • Realistic AI Influencers
      • Hyper Realistic Aitana Lopez example
    • Talking Avatars
      • Talking Avatar with LALAMU and LEONADO
      • Talking Avatar with D-ID, Leonardo.Ai, Remove.bg and LeiaPix
      • Tokkingheads Lipsync
      • Talking Avatar using Wav2Lip
      • Talking Avatars with Stable Diffusion
      • Avatars - Lexica.art, Remove.bg and D-ID
      • Articles on Talking Avatars
        • The 10 Best Talking Avatar Software for 2023
        • 11 Best Free Talking Avatar Creators in 2023
      • Clone Yourself with Synthesia and Eleven Labs
    • Stable Diffusion Tutorials
      • Stable Diffusion Checkpoint Models
    • LoRA Guide
      • Creating Realistic AI-Models of Humans for Animation
        • Tools Used
        • Step 1: Prepare Images
        • Step 2: Training your LoRA Model Dataset
        • Step 3: Creating our Puppet
      • Fine-Tuning A Model with Kohya
        • LoRA Training Videos -Robert Jene 1
        • LoRA Training Videos -Robert Jene 2
    • Astragallery
  • 🔲AI TECHNOLOGY
    • 𝐀𝐈 𝐀𝐥𝐠𝐨𝐫𝐢𝐭𝐡𝐦𝐬 𝐒𝐢𝐦𝐩𝐥𝐢𝐟𝐢𝐞𝐝
    • Foundation Models
      • NLP, CV, Gen-AI Foundation Models
    • Artificial Neural Networks (ANN's)
      • Machine Learning (ML)
      • Deep Learning (DL)
      • Human Brain Vs. Computer Brain
    • ANN Deep Learning Architectures
      • 1. Feed-Forward Neural Networks (FFNs)
        • a) Fully Connected Networks or Multilayer Perceptrons (MLPs)
        • b) Convolutional Neural Network (CNNs)
          • (i) Residual Network (ResNet)
          • (ii) AlexNet (Convolutional Neural Network)
      • 2. Recurrent Neural Networks (RNNs)
        • a) Basic Recurrent Neural Networks
        • b) Long Short-Term Memory Networks (LSTMs)
        • c) Gated Recurrent Units (GRUs)
        • d) Bidirectional RNNs
        • e) Sequence to Sequence Models
      • 3. Transformers
        • a) Transformer (Base Model)
        • b) BERT (Bidirectional Encoder Representations from Transformers)
        • c) GPT (Generative Pretrained Transformer)
        • d) T5 (Text-to-Text Transfer Transformer)
        • e) BART (Bidirectional and Auto-Regressive Transformers)
        • f) RoBERTa, ALBERT, DistilBERT
    • Generative Ai Architectures & Models
      • Generative AI Architectures
        • a) Variational Autoencoders (VAEs)
        • b) Diffusion Models
        • c) Generative Adversarial Networks (GANs)
        • e) Transformers
        • f) Flow-based models
      • Generative AI & LLM's for Text
        • Falcon 180B
        • GPT-3 (Generative Pre-Trained Transformer-3)
        • GPT-4 (Generative Pre-Trained Transformer-4)
        • LaMDA (Language Model for Dialogue Applications)
        • LLaMA (Large Language Model Meta AI)
          • LLaMA Model Card
        • PaLM 2 ( Pathways Language Model 2)
        • Bard (Google)
        • BLOOM (Big Language Model Open for Open Research)
        • Claude 2 (Anthropic)
        • Azure OpenAI (Microsoft)
        • T5 (Text-to-Text Transfer Transformer)
        • Large Language Models (LLMs)
      • Generative AI Models For Video and Image Synthesis
        • Generative Video
        • Generative Images
          • DALL-E & DALL-E2 (OpenAi)
          • Stable Diffusion (StabilityAI)
          • StyleGAN2 (NVIDIA)
          • CLIP (OpenAI)
            • Details on CLIP
          • MIDJOURNEY
          • BigGAN (Google)
          • IMAGEN (Google)
          • GigaGAN
      • ControlNet
      • LoRA (Low-Rank Adaptation of Large Language Models)
        • Training a LoRA Model
        • Mastering LoRA
      • Pre-Training (Initializing the Network)
    • Zero-Shot Video Generation
    • Symbolic Reasoning AI
    • Neuro-Symbolic AI
    • Vision Transformer (ViT)
  • 🔲GLOSSARY OF AI TERMS
    • Keywords and Hashtags
Powered by GitBook
On this page
  1. AI TECHNOLOGY
  2. ANN Deep Learning Architectures
  3. 3. Transformers

a) Transformer (Base Model)

Previous3. TransformersNextb) BERT (Bidirectional Encoder Representations from Transformers)

Last updated 1 year ago

🔲