
Weaviate Podcast GPT Index and Weaviate with Jerry Liu and Bob van Luijt - Weaviate Podcast #37
5 snips
Feb 22, 2023 AI Snips
Chapters
Transcript
Episode notes
Tree Index
- GPT Index uses a tree index, hierarchically summarizing text chunks to compress information.
- This structure allows LLMs to efficiently search and retrieve relevant information.
Simpler Approach
- While the tree index was a useful experiment, a simpler approach is often more effective.
- Splitting documents into chunks, embedding them, and using a vector store works surprisingly well.
Searching the Tree Index
- Searching a tree index involves navigating summaries at different levels.
- Starting with top-level summaries, the search progresses down to more specific ones.

