Clothing...........thought of the day

I have been reading a lot lately of many ladies getting discouraged and want to quit with weight lifting or healthy diet and exercise because their clothes still fit them. My thought ( because I have been guilty and discouraged by this same thought/ behavior) is because we weren't wearing the right sizes in the first place? We didn't want to buy a size larger and we fit our bodies into clothing that mostly fit our bodies?