Llion Jones

In this engaging discussion, Llion Jones, co-founder of Sakana AI and co-author of the Transformer architecture, shares insights on the need for innovation beyond Transformers in AI research. Joined by Luke Darlow, a specialist in biologically inspired models, they explore the limitations of current AI paradigms and introduce the Continuous Thought Machine (CTM). This novel model emphasizes internal reasoning and adaptive computation, aiming to enhance how AI processes information. Expect fascinating analogies and thought-provoking concepts that challenge the status quo!

Llion Jones, AI researcher and coauthor of the paper that introduced the transformer, talks about how open, pressure-free exploration produced major breakthroughs. He describes how competition and short-term incentives narrow research. He argues for more speculative, long-shot projects and shares examples of creative, curiosity-driven work that thrived when given freedom.