OT: Email problems.

I have my internet through a local cable company,  I don't use their email sight but use Windows Live Mail.  All of a sudden some of the emails sent to me are bouncing and saying I don't have a outlook.com mailbox.  I checked today and there is a outlook mail box besides the Windows Live Mail.  How do I get rid of outlook.com without losing Windows Live Mail?  Any help would be appreciated by me.

Thank you!