Environment Variables cover image

We Answer Your Questions!

Environment Variables

00:00

The Problem With AI in LLMs

There's a significant amount of compute being used in LLMs and there's not a lot of transparency on it right now. One of the problems that we see is that you basically are running up against the limits of the grid right now because computer because data centers are such dense uses of electricity. A data center full of these kind of cards will use more power than a grid is able to actually deliver to it. Between 6-8% of all EC2 spending is now going towards this but it's growing extremely quickly.

Play episode from 07:38
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app