Tokenization and Context Windows

As a Senior engineer, explain Tokenization and Context Windows. What problem does it solve and how would you describe it in an interview?

Answers use simple, clear English.