Maintaining a healthy weight, while losing remaining fat.

At my lowest weight I was 179. For perspetive, I am 6'5", 36 years old, male.

I wasn't completely happy with my body, I still had some fat around my stomach, side area that I would have liked to get rid of. I've been advised not to go any lower. I am currently a bit higher since I've gained some weight. When I get back down to around 180, I probably shouldn't go lower, but how would I be able to maintain at that weight but still lose the remaining fat? I have a nice set of resistance bands I can use, but would not be able to access a gym. I can do body weight exercises.

Do I just eat at a maintenance level and work my muscles, and would the fat slowly go away while maintaining my weight? I know it is a slow process, but I want to have a lean body without having to go lower.

Replies