Intro

If you don't want to lose weight, but do want to lose some body fat, about the only other option would be to start a well-designed progressive strength training program, stick with it faithfully, get overall good nutrition (especially but not exclusively ample protein), and be patient.

Adding muscle at constant weight will decrease body fat, basically using some of that body fat to fuel the building of new muscle mass. It's quite a gradual process, under the best of circumstances, but can have a big payoff in health and later-life thriving, some ability to do more in daily life in ways that are helpful, and of course appearance improvement (loss of love handles and other ways).

To lose love handles, there are really only two realistic options: Lose some more fat (cut), or gain some muscle at constant weight.

I don't have an opinion about whether you'd look skinny at current muscularity but lower weight. That's your call.

Best wishes in your quest!