
Last Week in AI #128 - generative search, GPU black market, GPT-4’s Secret, Sam Altman’s World Tour
46 snips
Jul 5, 2023 Google's expanding generative AI search alters how we seek information, sparking competition with Microsoft. ByteDance's $1 billion GPU acquisition highlights the desperation in China's tech market amidst geopolitical tensions. OpenAI's upcoming app store aims to transform AI solutions' accessibility. The rise of AI-generated voices in audiobooks raises ethical questions while collaborations with Hugging Face and AMD push model performance. Global dialogue on AI safety is intensifying, especially concerning crowdsourced work and the implications of deepfakes.
AI Snips
Chapters
Transcript
Episode notes
China's GPU Black Market
- A Chinese underground market exists for high-end NVIDIA GPUs, even legally sold ones.
- This market involves excess stock, third-party imports, and fraudulent chips.
AI-Generated Content Degradation
- Training AIs on AI-generated content leads to quality degradation over generations.
- This "curse of recursion" results in nonsensical outputs, impacting future models.
GPT-4's Architecture
- GPT-4 likely uses a "mixture of experts" model, combining eight smaller models.
- This approach improves efficiency and allows specialization within the model.
