Select contacts by Category while in an email

Is there a way when you click on the to/cc/bcc in a new email that you can change the view of contacts to include category?

I have 600+ contacts that I have separated into 12 categories.  I would like to send an email to some of the contacts in 4 out of the 12 categories.  When you click on the to/cc/bcc there is no way to tell which of the 400 contacts are in which of the 4 categories I need to send to.

I know you can select the entire category, expand the list to see all contacts in that category, and then eliminate the ones you don't.  It would be easier to pick the 50 contacts that I do want instead of eliminating the 300 or more contacts that I do not want.

I also know that you can start in your contacts category list, highlight the contacts you want and send email, the down side of this is having to repeat this process for each category that you want contacts from. Again not a difficult task, just looking for a one step process.

Thanks!