more fat?

peanut7butter

Okay, so I love peanut butter, in case my name wasn't obvious. I make overnight oats every morning using a whole banana and 1 tbsp peanut butter for topping, but I realized if I adjust the recipe a bit I can add another tbsp of peanut butter and have the same calories but more protein and fat (I am not losing weight right now, btw). I eat fruit at other meals, would it be so bad to only use half a serving? Is replacing fruit with fat bad?