Sebastian Raschka

Swyx, AI writer and commentator, and Sebastian Raschka, ML professor specializing in interpretability, join to dissect distillation, benchmarks, and model memorization. They debate detection limits for API-based distillation, teacher-student dynamics, and logits vs open-weight approaches. Sweebench and its vulnerabilities to leakage and curation issues are also explored.

Sebastian Raschka, an assistant professor at the University of Wisconsin-Madison and lead AI educator at Grid.ai, discusses his hands-on approach to AI education. He shares insights from his book, stressing the importance of practical applications for beginners. The conversation also covers PyTorch Lightning’s role in streamlining deep learning and explores ordinal regression's significance in real-world scenarios. Razchka emphasizes creating accessible resources and the innovative course design that enhances learning experiences in machine learning.