ML experimentation platform

Design an experimentation platform for evaluating ML model changes (ranking, recommendations, pricing) across a product with 100M users and dozens of teams running concurrent experiments. It must assign users to variants consistently, prevent overlapping experiments from confounding each other, compute statistically valid results with guardrail metrics, and let a team safely ramp or roll back a model. Cover assignment, the metric pipeline, and how you handle interaction between experiments.