AWS Certified Machine Learning Engineer - Associate MLA-C01 — Topic 1 Question 15

Question

A company has deployed an XGBoost prediction model in production to predict if a customer is likely to cancel a subscription. The company uses Amazon SageMaker Model Monitor to detect deviations in the F1 score. During a baseline analysis of model quality, the company recorded a threshold for the F1 score. After several months of no change, the model's F1 score decreases significantly. What could be the reason for the reduced F1 score?

Accepted Answer

Correct answer: A. The correct answer is A. Option A: Concept drift occurred in the underlying customer data that was used for predictions.

AWS Certified Machine Learning Engineer - Associate MLA-C01 — Question 15