Partitions, Keys, and Ordering

What are the key trade-offs of Partitions, Keys, and Ordering? When would you choose it vs alternatives?

Answers use simple, clear English.