AI Without Illusions

csbaby

Are you a software engineer transitioning into the AI world? AI Without Illusions is an AI-native channel that breaks down the foundational papers and architectures of modern ML. Tailored for seasoned engineers, we bypass the heavy math to deliver clear, intuitive explanations on how AI truly works.

Episodes

  1. 4d ago

    EP2: The Physics of LLMs - Why Size Matters & When It Doesn't

    Scaling Laws & Compute Budget: The sources extensively cover the foundational empirical scaling laws, showing that a model's performance improves smoothly as a power-law with model size, dataset size, and compute budget. For your practical rule on splitting a compute budget, the sources highlight that larger models are significantly more sample-efficient. Therefore, to be optimally compute-efficient, you should allocate the budget toward training very large models and stopping significantly short of convergence, rather than training smaller models to absolute convergence.Emergent Abilities: The sources reference the work of Wei et al. on the emergent abilities of Large Language Models, which aligns perfectly with your plan to discuss how scaling unlocks capabilities like in-context learning.

    18 min

  2. 5d ago

    EP1: Transformer & The Power of Scale

    A breakdown of modern LLM architecture tailored for software engineers. We explore how the Transformer revolutionized AI by processing text in parallel to replace older, sequential RNNs. We also demystify the "self-attention" mechanism, explaining how it uses Queries, Keys, and Values much like an information retrieval system to build deep contextual understanding. Finally, we dive into empirical Scaling Laws, revealing how the massive scale of models like the 175-billion parameter GPT-3 unlocked "in-context learning"—the emergent ability to perform completely new tasks on the fly just by reading a prompt, without requiring any underlying parameter updates or fine-tuning

    20 min
  • 2 Episodes

About

Are you a software engineer transitioning into the AI world? AI Without Illusions is an AI-native channel that breaks down the foundational papers and architectures of modern ML. Tailored for seasoned engineers, we bypass the heavy math to deliver clear, intuitive explanations on how AI truly works.

Information

  • Creator
    csbaby
  • Years Active
    2K
  • Episodes
    2
  • Rating
    Clean
  • Copyright
    © csbaby
  • Show Website
    AI Without Illusions