Do you add in exercise calories when trying to figure out how much to each in a day?

I only have a few lbs to loose but I can't stop loosing and gaining back the same 4-5lbs. Right now to loose a 1/2lb a week, I am suppose to eat 1590 calories. Every day when I add in the calories I eat, it is about 1800 calories but I walk 10,000 steps every single day and I do 30 minutes of bodyweight/strength workout videos 5 times a week. On top of that I do a fair amount of walking around my home and chores since I am a stay at home mom. Do I add in those exercise calories? If I do bodyweight under cardio I put in 15 minutes instead of 30 because I don't see how I could really work off that many calories. Same for walking my dog (10,000 steps) I do 30 minutes instead of the 60-90 minutes I actually walk in a day.

I feel like I keep doing really well and then binging after a few or several days of working my butt off. Last night I had a piece of cake and ended up eating cookies, nutella, peanut butter and oatmeal on top of that. I feel disgusted this morning and this is a once a week thing for me. I have been hungry all week and I think I just got sick of it last night and ate whatever I could get my hands on. So for me 1600 calories a day is really hard for me to stick to. I am up at 6am and in bed by 9pm and I eat a good 600-700 calories between 6am and 12pm because that is when I am most active.

I really need some accountability friends too if anyone is in the same boat or needs help too. I have been dieting and exercising for the last 20 years and being healthy is important to me but I feel like I take it too far sometimes. I wish I could figure out a good range of calories a day for me where I don't have these binge episodes.