weekly deficit?

Let's say i went to a huge party with tons of food last night, which put me at 4000 calories over my maitenance level. If i go in a big deficit for a few following days to balance those calories out, will it actually harm my metabolism? Some people say that weekly calorie deficit counts more than the daily one