Doing everything right, but gaining inches

Alittlebitmessy

I have been going on walks every other day, about 5 or 6 miles each time. I eat very healthy and am vegetarian. I also stay away from gluten (I have an intolerance) and also sugar.

I have been doing this for a week but I am GAINING INCHES

My legs are bulking and I was trying to do the opposite. I want to lose inches, not gain them.
It is just a matter of time, or should I walk less to prevent muscles from getting bigger?

I am getting very frustrated!