Transformer Self-Attention

You are a Mid-level on-call. A production issue might involve Transformer Self-Attention. How do you diagnose and mitigate?

Answers use simple, clear English.