fitbit messing up calorie intake

So I usually sync my fitbit at the end of the night, which has been messing up how much calories I have left at the end of the day. I usually end up with about 500-700 calories I have to eat back. Even when I sync my fitbit regularly throughout the day, I end up with a lot of calories remaining. It's frustrating since I'm not sure the calories remaining is correct.