Does it matter how you use your calories?
I'm not in any way suggesting that this is a good idea as I'm all for natural, unprocessed foods. But if you wanted processed/sugary foods; sweets, chocolate, cakes, etc, could you in theory eat just these, whilst keeping within your daily calorie allowance, and still lose weight?
