This Day in AI Podcast Amazon Bedrock & Titan LLM, Generative Agents, AutoGPT, Gambling Update & Joe Rogan Deep Fakes | E10
11 snips
Apr 14, 2023 AI Snips
Chapters
Transcript
Episode notes
Open Models Enable Prompt Innovation
- Open-source models and fine-tuning let practitioners experiment with new prompt formats or compressed domain languages.
- Rapid retraining on accessible models unlocks research beyond prompt engineering alone.
Plan For Inference Cost At Scale
- Estimate large-scale inference and training costs before choosing public APIs versus reserved cloud instances.
- For heavy, predictable workloads, reserve dedicated instances to cut cost and gain latency predictability.
Agents Chain Tasks But Drift Over Time
- Agent frameworks (AutoGPT, AgentGPT) chain tasks, tools, and memory to pursue goals autonomously in the background.
- Current agents still lose focus over time and need better long-term memory to behave reliably.