Tokenization and Context Windows

As a Tech Lead engineer, explain Tokenization and Context Windows. What problem does it solve and how would you describe it in an interview?

Answers use simple, clear English.