Sugar

In trying to up my calories with fruit and veggies... Fruit seem to be higher in calories, which is what I'm looking for; but the sugar! Is it ok to go over my daily sugar limit with apples, bananas, strawberries? Or will that affect my weight loss?