How do I get Outlook for Mac 2011 to display the email address to which my contacts are sending me emails?

I have multiple email addresses associated with my outlook for Mac account and when I receive an email from someone there is no way for me to know which email address they've sent it to. The "To" display is just my generic contact name. When I click on the contact card it shows every single email address I have associated with my contact card and doesn't distinguish which email account they contacted me through. I'm receiving spam now too, all of a sudden, and would like to eliminate the email address that has become the problem but can't do that without being able to see that email address displayed.