Need serious advice-eating too many calories...

Ok, so on days that I don't exercise like today, my total calories were 2100...I usually eat between 1500-2,000 calories with exercise I burn around 500 or so calories per day. I'm just worried that if I eat around 2,000 calories twice a week on my rest days, I won't lose 2 pounds per week or any weight. I'm sorry if I'm being paranoid! Any advice, pleaseeee???