Apple Music Human Evaluation Lead

• Collaborated with cross-functional teams to test new Apple Music search features before A/B: set launch criteria, created evaluation input sets for statistical analysis, analyzed human annotated data for loss patterns, stayed flexible with project scope changes, and provided user-friendly reports on final launch decision. 

• Run internal user studies to support quantitative and qualitative evaluations: conducted user and product research, created surveys, conducted user interviews, created mockups and prototypes for internal products.

• Connected Product and Engineering teams to marry the technical statistical analysis with the user experience vision for the product: created product insight reports with specific action items for AI/ML models.

• Worked proactively with a new Primephonic team, developed innovative solutions to evaluate a yet-to-be-released Apple Music Classical app from start to finish, and insured high search quality at launch worldwide.