Always over on Sugar

I am consistently over on sugar. Some days I know why others I don't get it. Is that going to slow my weight loss down?