Maybe kind of a long story...stay with me please

So last year everything was great, was comfy in my clothes and that's what was important to me at the time. I'm 5'10 and weighted about 162. I've also played roller derby for the last 4yrs.
Anyhoo, we moved in November, and everything went to crap. I gained 12lbs, was waiting to get settled before trying to find a team to play on, etc.
Finally in mid January I joined a team and got back on the regular practice schedule (2x a week for 2hrs) and measuring with a chest strap HRM, burning 1000-1200cals per practice! That's part 1 of my issue. You would think at the very least if I ate the same, but maintained the regular practice schedule, I'd see soooome kind of change on the scale? yeah, wasn't happening.
Since I'd had enough of feeling uncomfortable in my own skin and some of my regular pants I couldn't wear b/c they were too tight, I decided to do something about it.
Next, i cut out my daily 2-3cups of coffee that had about 300cals worth of creamer in it to 1 cup in the morning on the weekend (took vitamin with caffeine to manage that). I really only drink water all day (70-90oz/day, been like that forever).
I'm almost at 2wks of consistently logging every day, right around 1200cals. Just this week I started adding in some arm workouts with 8lb dumbbells and some specific leg/bum exercises annnd walking for about 30mins/day.
After all of this, I have lost 4lbs in 5wks...does that make sense? Am I really expecting too much too fast? I honestly didn't think so considering all the changes I've made in the last month or so...
*I'm a creature of habit when it comes to food just for ease of it...such as oatmeal and banana in the morning...special k with 2% milk; eggs, spinach, salsa on whole wheat bread; healthy dinner recipes from the six o'clock scramble site...