The first bite is the worst

I can kind of relate. I tend to work out first thing in the mornings before breakfast for a couple of reasons. One, I seem to not be as hungry during my workout if my stomach is empty. Two, after I eat I want more, and tend to be a bit more lethargic. But you shouldn't be afraid of it. What helped me, especially after my metabolism went way up from exercising every morning first thing, is splitting up my meals to 5-6 a day instead of 3 big ones. So my day now looks like this:

Pre-Workout - before breakfast, either something with caffeine, water, coffee, or a pre-workout drink, no food.
Breakfast - after my workout, bran cereal with some sort of fruit and a protein shake
Mid-Morning snack - usually a protein bar
lunch - high protein lunch if possible, low calorie, usually under 500 cals
dinner - larger meal usually, high protein if possible, lots of veggies as sides, maybe a baked potato or sweet potato
late snack - no sugar added ice cream if I have the calories left. Good for fiber, some protein, and yummy with low calories

My biggest time that I am not eating is between lunch and dinner, and during that time I chew sugar free gum if I want. In between eating anything throughout the day I drink a glass of water too. Keeps me from being hungry most of the day at all, and when I get a craving it's easy to ignore because usually within a couple of hours it'll be time to eat again.