Bias-Variance Trade-off and Overfitting

What common mistakes do candidates make around Bias-Variance Trade-off and Overfitting, and how do you avoid them?

Answers use simple, clear English.