Bias-Variance Trade-off and Overfitting

You are a Architect on-call. A production issue might involve Bias-Variance Trade-off and Overfitting. How do you diagnose and mitigate?

Answers use simple, clear English.