Josh Albrecht

Josh Albrecht, Imbue co-founder and applied ML engineer; Daniel Kunin, Berkeley postdoc studying mathematical principles of intelligence; Jamie Simon, Imbue research fellow and physics-trained deep learning theorist. They explore a proposed “learning mechanics” — a physics-like theory of deep learning. Short takes cover why theory is needed, scaling and limit behaviors, progressive sharpening and edge-of-stability, universality of representations, and how theory and mechanistic interpretability can work together.

In this engaging discussion, Josh Albrecht, CTO and co-founder of Imbue, shares insights on building more robust AI agents. He highlights the significant challenges in developing effective AI for enterprise, emphasizing the importance of domain expertise and high-quality data. Albrecht also discusses the role of graph databases in enhancing data modeling and the value of prototype testing for user interfaces. The conversation wraps up with a look into the future of AI and its transformative potential in the workplace.

Josh Albrecht, CTO of Imbue, shares insights on creating AI agents that excel in reasoning and reliability. He discusses the shift from supervised to self-supervised learning, emphasizing the impact of quality data on AI performance. Albrecht reveals advanced reasoning techniques like chain of thought and tree of thought, showcasing how they enhance accuracy over extended tasks. He also explores the interplay of reasoning and knowledge in AI, alongside the critical need for international collaboration in AI safety and policy.

In this engaging discussion, Jonathan Frankle, Chief AI Scientist at Databricks, and Josh Albrecht, CTO of Imbue, dive into groundbreaking advancements in AI. They unveil Imbue 70B, a model outperforming GPT-4o with significantly less data. The duo shares insights on the complexities of scaling GPU clusters and the importance of high-performance infrastructure. They also address evaluating language models and introduce innovative tools for hyperparameter tuning. Their expertise shines through as they explore the future of AI in coding and reasoning tasks.

Josh Albrecht, CTO of Imbue, discusses the limitations of current language models (LLMs) in making ethical decisions. The podcast explores imbue's mission to create robust and safe AI agents, the potential applications and limitations of AI models, and the need for improvements in LLMs. The speakers also touch on reevaluating metrics, liability for AI systems, and societal issues in machine learning research.