Design a Feature Store for Machine Learning — System Design Interview Practice
Design a feature store that serves features for both training and inference, ensures consistency between offline and online features, handles feature transformations, and provides feature discovery and governance. Work through the requirements, architecture trade-offs, and an interactive design review.
Requirements and concepts to consider
- Serve features for batch training and online inferenceRequirement
- Ensure offline-online feature consistencyRequirement
- Compute features from streaming and batch sourcesRequirement
- Support point-in-time correct feature joinsRequirement
- Provide feature discovery and documentationRequirement
- Track feature lineage and dependenciesRequirement
- Implement feature monitoring and quality checksRequirement
- Support feature sharing across teamsRequirement
- mlopsConcept to explore
- feature storeConcept to explore
- feature engineeringConcept to explore
- online servingConcept to explore
- data managementConcept to explore
- ml infrastructureConcept to explore