Transformer Self-Attention

Go deep on Transformer Self-Attention: edge cases, scalability limits, and how you'd evolve the solution over 2 years.

Answers use simple, clear English.