Exploring Multi-Modal AI: Merging Text and Visual Data

2024 promises to be the year of multi-modal AI, and we are already seeing some amazing things. In this “fully connected” episode, Chris and Daniel explore the new Udio product/service for generating music. Then they dig into the differences between recent multi-modal efforts and more “traditional” ways of combining data modalities.

Sponsors:

• Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
• Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

Featuring:

• Chris Benson – Website, GitHub, LinkedIn, X
• Daniel Whitenack – Website, GitHub, X

Show Notes:

• Udio
• CLIP
• BridgeTower
• LLaVA

Upcoming Events: 

• Register for upcoming webinars here!