Deleting emails from Apple’s Mail & it goes in the POP folder

When I delete my emails from Mail on the Apple Desktop they are not deleted from my hotmail, they just go to POP. When I open hotmail and get the pop notification on the bottom I press change setting but then it says something is wrong with outlook. That happens every time I press change setting. How can I make it that when I delete emails from my Mail on the apple desktop it deletes it from hotmail, same things when sending emails to drafts....etc