Tokenization and Context Windows

As a Mid-level engineer, explain Tokenization and Context Windows. What problem does it solve and how would you describe it in an interview?

Answers use simple, clear English.