I'm having a hard time eating enough calories

At the end of the day I still have 200-300 calories left over from my day. I know this is not good, but I am having a hard time eating enough through out the day. I think I am scared I'm gonna go over my allowed calories. Any suggestions?