Exercise Calories Factored IN?

Options
Not sure if this is the right board...but...
I have been adding my cardio calories in and eating them back. My fitness level, as some have suggested, is set at Sedentary; therefore, it stands to reason that any exercise calories that aren't put back in to my body might push me into starvation.
BUT...if I change my fitness level to light active or moderately active, do those include built in exercise calories into my daily recommended calorie intake? Or should I still be logging exercise and eating back the calories?
If I have confused you, let me know and I will try to clarify...thanks!!