Last Week in AI #126 - few have tried ChatGPT, Baidu’s $145M AI fund, AI job culling, OpenAI grant program
43 snips
Jun 13, 2023 Discover the surprising fact that while many Americans have heard of ChatGPT, few have tried it. Unpack Baidu's ambitious $145M AI fund aiming for AI self-reliance in China. The podcast examines the alarming trend of AI job losses, with 4,000 positions cut last month alone. Learn about innovative AI tools, from Zoom's meeting summaries to Microsoft's new generative app in India. The rapid growth of the AI market is projected to soar past $1 trillion by 2028, igniting a tech stock rally. Tune in for insights on AI's evolving role in our lives!
AI Snips
Chapters
Transcript
Episode notes
Scaling Laws and Data Limits
- When data is limited, repeating training runs can extend chinchilla scaling laws.
- However, excessive repetition provides diminishing returns, requiring new scaling laws.
Transformer Limitations
- Transformers rely on pattern matching and shortcut learning, limiting compositional task performance.
- Iterative approaches and agent-based systems can address these limitations.
Plugin Security Risks
- ChatGPT plugins introduce prompt injection vulnerabilities via PDFs, websites, etc.
- Carefully implemented plugins with context awareness can mitigate these risks.