A 72B Model for Just Millions

Sam Dare explains Templar’s decentralized 72B training run, its cost structure, progress curve, and why the result mattered for crypto credibility.

Play episode from 35:01

chevron_right

Transcript

chevron_right

Transcript

Episode notes

This Week In Startups is made possible by:

Wispr Flow - https://wisprflow.ai/twist

Circle - http://circle.so/twist

Deel - http://deel.com/twist

Today’s show:

AstroForge is building low-cost, replicable spacecraft to mine platinum group metals from near-Earth asteroids — a $60 billion annual market for materials that are running out on Earth. Founder and CEO Matt Gialich joins the show to talk about the company's ambitious mission, what went wrong on their first two flights, and why Mission 3 could still change everything.

PLUS Sam Dare from Templar stops by to talk about training AI models on a decentralized blockchain, and why it’s so much cheaper and more efficient than the conventional “data center full of GPUs” method. AND a demo of OpenOats from creator Yazin Alirhayim of his open source Granola alternative.

Astroforge: https://www.astroforge.com/

Templar: https://www.tplr.ai/

Epoch AI decentralized training post: https://epoch.ai/gradient-updates/how-far-can-decentralized-training-over-the-internet-scale

OpenOats on Github: https://github.com/yazinsai/OpenOats

Timestamps:

0:00 Intro

0:59 Plaud: If your work depends on conversations — interviews, meetings, calls — you need a Plaud NotePin. You can check it out at https://Plaud.ai/twist and use code TWIST for 10% off!

3:05 We aplaud Plaud!

3:18 Astroforge is mining… asteroids?!

6:11 How creating an abundance of Platinum will impact Humanity!

9:56 Wispr Flow: Stop typing. Dictate with Wispr Flow and send clean, final-draft writing in seconds. Visit https://wisprflow.ai/twist to get started for free today.

21:16 Circle: The easiest way to build a home for your community, events, and courses — all under your own brand. TWiST listeners get $1,000 off the Circle Plus Plan by going to https://circle.so/twist.

22:01 How Astroforge uses capitalism to unlock abundance

24:35 J-Cal subscribed to… A socialist magazine?

26:19 Sam Dare of Templar joins the show!

27:47 What is TAO doing that's uniquely different from Bitcoin

30:15 What is the incentive mechanism that Templar uses?

30:44 Deel - Founders scale faster on Deel. Set up payroll for any country in minutes, hire anyone anywhere, get visas handled fast, and get back to building. Visit https://deel.com/twist to learn more.

37:49 How much does it cost to run templar's model?

45:16 Can decentralized training over the internet scale? https://epoch.ai/gradient-updates/how-far-can-decentralized-training-over-the-internet-scale

47:16 Jason addresses his tao investment

48:48 Why brand is the moat for startups

49:47 When will a better, more exciting version of Bitcoin, can come along?

52:20 Yazin of OpenGranola Joins the show

53:36 How OpenGranola has local LLM's taking notes for you and giving you real time insights in your meeting!

1:01:45 Jason's callout for a sidebar that shows all inputs from agents

1:13:50 The economics of the new harry potter series and HBO/ Warner Brothers

1:23:33 Why Jason wants government surveillance on Disney adults…

Subscribe to the TWiST500 newsletter: https://ticker.thisweekinstartups.com

Check out the TWIST500: https://www.twist500.com

Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcp

Follow Lon: