Bias-Variance Trade-off and Overfitting

As a Mid-level engineer, explain Bias-Variance Trade-off and Overfitting. What problem does it solve and how would you describe it in an interview?

Answers use simple, clear English.