It's really important to keep in mind that your muscles retain a lot more water than normal when they are growing. That's why when you first begin working out and you've got those sore muscles, it's really common to first gain a pound or two. Just make sure you are getting in a gallon of water a day (or as much as you possibly can!) and try to keep away from the scale for the first few days to avoid getting discouraged! I also gained when I first started...now I'm down 6 pounds!

Yes, your muscles do retain water upon first working out. However, weighing yourself every day is setting yourself up for failure. I can start off the day at 126 pounds and finish it at 130 by the end of the day because of all the food and water in me. Everyone should weigh themselves once a week only, first thing in the morning after using the bathroom. This will give you a better grasp on whether you are gaining weight, losing weight, or maintaining weight. This is why I lose two pounds a week.

Good luck @rjpittner You'll do amazing!

WARNING: this will be a long post.
This is for myself but also because I've had friends say that my own struggle and fight to get healthy has inspired them to get moving. At the beginning of this year I set some goals for my weight loss. There were 5: stop drinking soda, do Zumba twice a week, log every meal into MFP, see my personal trainer once a week and lose 80 pounds by the end of October.
I still have soda, but it's maybe a couple times a month rather than every day. I haven't logged every meal for the past few months but I'm on a streak right now PLUS I've made more friends on MFP which equals more support. I don't do Zumba twice a week but I am doing something at least twice a week. And I'm nowhere near where I need to be to lose 80 pounds by October.
But I was reminded by someone I follow on MFP and Instagram, someone who has already lost the amount of weight I want to lose, that it's a hard journey and it takes time. I weigh myself every morning (or try to) as it's a reminder of what I'm trying to change. There are different thoughts on this and mine is: I see what I weigh, I see changes from good stuff and bad and it reminds me to keep going. Sometimes I get discouraged (alright, often) but this morning while logging on MFP I decided to look at my weight graph for the past year and the big picture is speaking to me.
Each line equals 10 pounds. I've been locked in this 5 pound range for a while and it's been frustrating me, trying to break out of it. But when I stepped back and looked at the year, I've actually accomplished more than I thought I did. I'm not done and obviously there were spikes when dips would have been better but - I'm still working. I WILL break out of this range and then continue on my downward trek. Just needed to look back and see how far I've come before continuing this morning.