The Lifecycle of Developing Overall Evaluation Criterion in AB Testing for Netflix Messaging
Sophia Liu, Alex X. Liu · 2022
Many organizations use multiple key metrics to measure success for online controlled experimentation. By combining multiple metrics, we introduce Overall Evaluation Criterion (OEC) which aligns with organizational long-term success. We will cover the definition of OEC, its critical properties, a case study on Netflix Messaging and four critical key steps in designing your own organizational OEC.