How to Keep Old Email Addresses From Popping Up in OS X Mail

I want to delete old email addresses from the Compose window on my Mail app. Is there a way to do that?

Mail’s address field is auto-populated as you type with addresses from Contacts (formerly Address Book) as well as addresses you’ve previously sent and received email from. There’s no one-click way to clear all of those out, but you can remove them one by one — handy if you, say, tried to send a message to a misspelled address and that misspelling keeps coming up as an option.