Design a Conversational AI Platform with RAG — System Design Interview Practice
Design a conversational AI platform that uses Retrieval-Augmented Generation (RAG) to answer questions from enterprise knowledge bases, maintains conversation context, and provides cited responses. Work through the requirements, architecture trade-offs, and an interactive design review.
Requirements and concepts to consider
- Ingest and index enterprise documentsRequirement
- Retrieve relevant context for user queriesRequirement
- Generate grounded answers with citationsRequirement
- Maintain multi-turn conversation historyRequirement
- Support multiple knowledge sourcesRequirement
- Handle ambiguous and follow-up questionsRequirement
- Implement guardrails against hallucinationRequirement
- Provide feedback collection and response ratingRequirement
- aiConcept to explore
- ragConcept to explore
- llmConcept to explore
- conversational aiConcept to explore
- knowledge baseConcept to explore
- embeddingsConcept to explore