1. Building LLMs like ChatGPT from scratch and Cloud Deployment

    • Buy now
    • Learn more
    • Discussions

  3. Introduction

    • Course Introduction
    • What you'll learn
    • Colab Notebooks

  4. Pre-requisites

    • RNNs and Attention Models
    • How the transformer works
    • Difference in training and inference

  5. Building Mistral from scratch

    • Global Architecture of Mistral
    • Tokenization
    • Rotary Positional Encoding (RoPE)
    • RoPE Practice
    • Group Query Attention
    • Sliding Window Attention
    • Kv-caching
    • Transformer Block
    • Full Transformer Model

  6. Deploying Mistral to the cloud (Runpod)

    • Deployment
  1. Products
  2. Course
  3. Section
  4. Lesson

Global Architecture of Mistral

  1. Building LLMs like ChatGPT from scratch and Cloud Deployment

    • Buy now
    • Learn more
    • Discussions

  3. Introduction
    • Course Introduction
    • What you'll learn
    • Colab Notebooks

  4. Pre-requisites
    • RNNs and Attention Models
    • How the transformer works
    • Difference in training and inference

  5. Building Mistral from scratch
    • Global Architecture of Mistral
    • Tokenization
    • Rotary Positional Encoding (RoPE)
    • RoPE Practice
    • Group Query Attention
    • Sliding Window Attention
    • Kv-caching
    • Transformer Block
    • Full Transformer Model

  6. Deploying Mistral to the cloud (Runpod)
    • Deployment