Design an Autonomous Vehicle Perception System — System Design Interview Practice
Design the perception stack for an autonomous vehicle that fuses data from cameras, LiDAR, and radar sensors, detects objects in 3D space, and tracks their movement in real-time. Work through the requirements, architecture trade-offs, and an interactive design review.
Requirements and concepts to consider
- Process multi-camera feeds in real-timeRequirement
- Process LiDAR point clouds for 3D detectionRequirement
- Fuse sensor data for unified world modelRequirement
- Detect and classify objects (vehicles, pedestrians, signs)Requirement
- Track object trajectories over timeRequirement
- Estimate depth and distance accuratelyRequirement
- Handle adverse weather and lighting conditionsRequirement
- Predict object motion for path planningRequirement
- aiConcept to explore
- autonomous vehiclesConcept to explore
- perceptionConcept to explore
- lidarConcept to explore
- computer visionConcept to explore
- sensor fusionConcept to explore