Sugar

I have been doing MFP for 4 weeks with some success but I do notice that every day I am far exceeding my allowance for sugar. Most of this is coming from non additive sources like fruit. Should I be concerned?