emails not arriving

Since I got changed over to Outlook last week (hate it by the way) some emails which have been sent to me don't arrive. And some emails I send don't arrive at the recipient's. I know very little about computers but have happily been using Hotmail for years and never had a problem. Is there a simple solution or would it be best for me to open up another email account eg googlemail or gmail? I just want things to be simple (and I find the new Outlook thing complicated) so any recommendations on a very simple email provider for us technophobic old people would be good too.