Question about sugar

Options
I have been taking a look at my sugar stats since I've started using my fitness pal and realized that, while they are not outrageous, they are higher than reccomended. The thing is, I do not eat candy or drink beverages with sugar. In fact, the only source of sugar in my diet is fruit. Does anyone know if it is bad to eat a lot of fruit? I know that some fruits have less sugar than others (i.e. berries have less than apples and bananas) but should I really be concerned?