Hungry after rest day normal?

Hi All,

I've been experience seriously hungry days the day after my rest days. Is that normal? I've been trying to stay on target with my calories as per IPOARM which is 1639, and feel like I'm eating enough, maybe up them? Kind of a scary thought.