Tokenization and Context Windows

As a Architect engineer, explain Tokenization and Context Windows. What problem does it solve and how would you describe it in an interview?

Answers use simple, clear English.