Number on the Scale goes up

I think the really important thing here is your comment that you are feeling much better and your shirt fits much better. With the combination of exercise and calorie watching you will both, over the long run, lose weight but you will also, more importantly tone up as you lose body fat and increase muscle mass. By volume muscle weighs more than fat, so weight gain can sometimes be explained by that. Also don't weigh yourself right after exercising you'll be full of water in your muscles and your weight will be up. Stay the course, the weight will come down, but you've already seen some very important results. Good on you.

What the scale says shouldn't matter if your clothes are fitting better. Weight also fluctuates due to water intake and certain foods. I wouldnt worry. You're doing great. You may also be building muscle. Good Job!