Help!

You said it - 4 days is not long, and you're being impatient. Stop weighing every day if it is going to make you stress, you sure as heck didn't gain weight in 4 days and won't lose it that fast either. Weight loss is not linear, and there are many, many things that can add to fluctuations. Case in point:

2 weeks ago I weighed my lowest ever. The following week I was under my calorie goal every day and worked out every day. Between that lowest weight and now, I went up 2.5lbs and as of this morning, I'm 1.5lbs down from that lowest point. What casued it? *shrug* hormones, water retention, the humidity, slower digestion... don't know. But fact is, if I hopped on the scale 4 days after that previous lower weight and let the fact that I was up derail me, then I'd not be at this new lowest weight now.