Fat vs. Sugar in yogurt.

I go over my sugar allowance daily and am wondering if switching from non-fat yogurt to low-fat yogurt would be a better option? It will increase my calories and fat intake, but may help me to lower the amount of sugar... any other suggestions ? I love yogurt :) Thanks !!!