i received a phone call at work whereby the caller stated he was from Microsoft and told me that my computer was sending error messages and that I had viruses and that he would show me how to fix it and like a fool, I let him have control of my computer.  Can that person gain access to my information that way?

I received the same call at my home,  My caller ID has him name and phone number.  Who do I report it to?