Big Technology Podcast
Big Technology Podcast
Alex Kantrowitz
Generative AI 101: Tokens, Pre-training, Fine-tuning, Reasoning — With Dylan Patel
42 minutes Posted Apr 23, 2025 at 2:57 pm.
0:00
42:09
Download MP3
Show notes

Dylan Patel is the founder and CEO of SemiAnalysis. He joins Big Technology Podcast to explain how generative AI work, explaining the inner workings of tokens, pre-training, fine-tuning, open source, and reasoning. We also cover DeepSeek’s efficiency breakthrough, the race to build colossal AI data centers, and what GPT-5’s hybrid training approach could unlock. Hit play for a masterclass you’ll want to send to every friend puzzled (or excited) about the future of AI.


---

Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.


Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology


Questions? Feedback? Write to: bigtechnologypodcast@gmail.com