Examination of Outlying Scale Fluctuation
steveko89
Posts: 2,223 Member
As I was logging my daily weight and calories into my spreadsheet, like usual, it occurred to me to check to see if I'd encountered any outliers in the 300+ data points I've collected dating back to July 2017. I'd inserted a Median absolute deviation row in my data set months ago; to this day I still only have recorded one weight that fails that outlier check, a weight of 186.8 lbs on Saturday 8/19/2017. Curiosity lead me to look back at the confluence of circumstances as a monstration of both the magnitude of scale fluctuations, the requisite surrounding circumstances, and the visibility afforded by daily weighing and diligent calorie tracking.
*For more information on median absolute deviation see:
https://en.wikipedia.org/wiki/Median_absolute_deviation
Executive Summary (TL;DR):
I once saw a swing of +5.8 lbs one day, and -8.8 lbs the next as a result of higher-than-usual carb/sodium intake followed by exercise and a lower-than-usual carb/sodium intake. Scale weight can be fickle, daily fluctuations vary greatly.
The long and meandering version:
This week was a bit of oddity in itself as I was traveling for work Tuesday-Thursday, one of only three trips I made all of last year, so I was unable to weigh myself on Wednesday or Thursday morning, and ate out for lunch, and dinner Tuesday & Wednesday, and breakfast & lunch on Thursday; certainly somewhat of a limitation to my calorie counts for those days. However, weight and calories had been fairly consistent leading to this point.
Sun 8/13 - 181.0
Mon 8/14 - 180.4
Tue 8/15 - 180.6
Friday 8/18 - 181.0
Moving average 8/18 per Happy Scale: 180.8
I was happy to see that my deviation in routine, schedule, and moderate indulgence in Southern cuisine (visited Lafayette, LA) did not have an overwhelming impact on the scale Friday morning. At the time I was working out 3x/week lifting on a full body workout plan. With the travel planned I did my Monday workout as usual, pushed my Wednesday workout to Thursday afternoon once I returned home on a morning flight, and shifted Friday's workout to Saturday to allow for adequate recovery; so no exercise was done on Friday.
Having been away and somewhat out of sync, that Friday was a bit of a culinary excursion. I had my usual breakfast protein shake and Oikos greek yogurt in the morning but had not adequately planned for lunch, which resulted in obtaining a protein bar, a bag of Smart food popcorn, and a bag of cheddar jalapeno Cheetos from the break room vending machine as lunch. My wife and I can only be described as breakfast-food-enthusiasts, so dinner that night was eggs, pancakes, and goetta (a Cincinnati favorite, hard to explain, kind of like a soft sausage that you pan fry, no oil or butter needed). The tally by the end of the day was 2962 calories, my average TDEE works out to ~2450, so call maintenance sans exercise at 2200. Obviously, this quantity of calories is over maintenance, but not necessarily egregiously. The bigger deviation came from the carbs, I typically keep to 70-100g carbs, however 8/18 saw 236g logged. This figure is probably somewhat low as I realize I logged pancakes but not any syrup... and what sort of animal isn't having syrup with pancakes. This far removed from that day I can only imagine that I decided to skip out on weighing/logging my portion of syrup since I already knew I was over my calories for the day and that 100-200 calories wasn't going to make a huge dent in my end-of-day number... little did I know I would be waxing poetically about said evening almost a year later. Additionally, I racked up 4800+ mg of sodium over the course of the day where I will rarely sniff the default limit for my size of 2300mg.
Sure enough, the next morning I was greeted with 186.8 lbs on the scale. "Well shoot, that's going to screw up my data", I thought... probably. Again, I don't really remember what was going on that day, aside from I know I worked out as planned because I recorded a workout with UA Record, following my typical-for-the-time, full body lifting scheme of Squats, Deadlift, Bench Press, Overhead Press, Rows, and Pull Ups. Looking at the food choices, I'm guessing my wife was out most of the day as I skipped breakfast, more than likely to workout in the morning, and had a 4-egg cheese omelettes for both lunch and dinner, accompanied by a protein shake and two yogurts. That's usually the sort of thing I'll do if I'm left to my own devices. The result was a modest total of 1704 cal, exceeding my 1g/lb protein goal with 184g, only 41g carbs and <1750mg sodium. Unfortunately, I didn't track water either Friday or Saturday, so I cannot provide any context for hydration effects. As a rule I'm generally bad at drinking enough water on the weekends, usually hit 8-10 cups/day while at work.
Sunday morning comes and I weigh in a a svelte 178 lbs!?! Sunday proceeded to be another day around maintenance at 2452, (516 of which were cupcakes...) and was back to my regularly scheduled programming that Monday with a weight of 181.6lbs, beginning a week that was on the front end of a pretty lengthy period of slow, yet fairly sustained loss, reaching a low of 170 lbs on January 20th, 2018.
Overall, I don't really know how valuable anyone will find any of this information but I thought it was interesting that the surrounding circumstances of that outlying data point were relatively mild in what, and how much I consumed. It wasn't like I went on a fast food-fueled bender, then fasted and ran a triathlon to sweat that many pounds away. It's entirely likely I didn't even go outside that Saturday, if I did it was probably for about an hour to cut the grass, not exactly an arduous task that would have a tremendous impact on my NEAT for the day.
*For more information on median absolute deviation see:
https://en.wikipedia.org/wiki/Median_absolute_deviation
Executive Summary (TL;DR):
I once saw a swing of +5.8 lbs one day, and -8.8 lbs the next as a result of higher-than-usual carb/sodium intake followed by exercise and a lower-than-usual carb/sodium intake. Scale weight can be fickle, daily fluctuations vary greatly.
The long and meandering version:
This week was a bit of oddity in itself as I was traveling for work Tuesday-Thursday, one of only three trips I made all of last year, so I was unable to weigh myself on Wednesday or Thursday morning, and ate out for lunch, and dinner Tuesday & Wednesday, and breakfast & lunch on Thursday; certainly somewhat of a limitation to my calorie counts for those days. However, weight and calories had been fairly consistent leading to this point.
Sun 8/13 - 181.0
Mon 8/14 - 180.4
Tue 8/15 - 180.6
Friday 8/18 - 181.0
Moving average 8/18 per Happy Scale: 180.8
I was happy to see that my deviation in routine, schedule, and moderate indulgence in Southern cuisine (visited Lafayette, LA) did not have an overwhelming impact on the scale Friday morning. At the time I was working out 3x/week lifting on a full body workout plan. With the travel planned I did my Monday workout as usual, pushed my Wednesday workout to Thursday afternoon once I returned home on a morning flight, and shifted Friday's workout to Saturday to allow for adequate recovery; so no exercise was done on Friday.
Having been away and somewhat out of sync, that Friday was a bit of a culinary excursion. I had my usual breakfast protein shake and Oikos greek yogurt in the morning but had not adequately planned for lunch, which resulted in obtaining a protein bar, a bag of Smart food popcorn, and a bag of cheddar jalapeno Cheetos from the break room vending machine as lunch. My wife and I can only be described as breakfast-food-enthusiasts, so dinner that night was eggs, pancakes, and goetta (a Cincinnati favorite, hard to explain, kind of like a soft sausage that you pan fry, no oil or butter needed). The tally by the end of the day was 2962 calories, my average TDEE works out to ~2450, so call maintenance sans exercise at 2200. Obviously, this quantity of calories is over maintenance, but not necessarily egregiously. The bigger deviation came from the carbs, I typically keep to 70-100g carbs, however 8/18 saw 236g logged. This figure is probably somewhat low as I realize I logged pancakes but not any syrup... and what sort of animal isn't having syrup with pancakes. This far removed from that day I can only imagine that I decided to skip out on weighing/logging my portion of syrup since I already knew I was over my calories for the day and that 100-200 calories wasn't going to make a huge dent in my end-of-day number... little did I know I would be waxing poetically about said evening almost a year later. Additionally, I racked up 4800+ mg of sodium over the course of the day where I will rarely sniff the default limit for my size of 2300mg.
Sure enough, the next morning I was greeted with 186.8 lbs on the scale. "Well shoot, that's going to screw up my data", I thought... probably. Again, I don't really remember what was going on that day, aside from I know I worked out as planned because I recorded a workout with UA Record, following my typical-for-the-time, full body lifting scheme of Squats, Deadlift, Bench Press, Overhead Press, Rows, and Pull Ups. Looking at the food choices, I'm guessing my wife was out most of the day as I skipped breakfast, more than likely to workout in the morning, and had a 4-egg cheese omelettes for both lunch and dinner, accompanied by a protein shake and two yogurts. That's usually the sort of thing I'll do if I'm left to my own devices. The result was a modest total of 1704 cal, exceeding my 1g/lb protein goal with 184g, only 41g carbs and <1750mg sodium. Unfortunately, I didn't track water either Friday or Saturday, so I cannot provide any context for hydration effects. As a rule I'm generally bad at drinking enough water on the weekends, usually hit 8-10 cups/day while at work.
Sunday morning comes and I weigh in a a svelte 178 lbs!?! Sunday proceeded to be another day around maintenance at 2452, (516 of which were cupcakes...) and was back to my regularly scheduled programming that Monday with a weight of 181.6lbs, beginning a week that was on the front end of a pretty lengthy period of slow, yet fairly sustained loss, reaching a low of 170 lbs on January 20th, 2018.
Overall, I don't really know how valuable anyone will find any of this information but I thought it was interesting that the surrounding circumstances of that outlying data point were relatively mild in what, and how much I consumed. It wasn't like I went on a fast food-fueled bender, then fasted and ran a triathlon to sweat that many pounds away. It's entirely likely I didn't even go outside that Saturday, if I did it was probably for about an hour to cut the grass, not exactly an arduous task that would have a tremendous impact on my NEAT for the day.
10
Replies
-
That's really a great writeup.0
-
Data geek swoon happening over here. Good stuff!
(The food reporting meander is a hoot, too: Bonus points. :drinker: ).2 -
Y'know, this really is worthy of a bump.2
-
This is beautifully geeky.2
-
Thank you for this. You have inspired me to record more data aka get to know my body.1
-
I enjoyed reading that, thanks.0
-
Looking at my spreadsheet this morning I discovered another weight outlier occurred on 2/25/19!
This one took far less of sleuthing to discern the cause; it was the Monday following our son's Christening which was preceded by:
Thursday 2/21 - 175.4 - 2881 calories, included cake and ice cream for niece's birthday, no exercise
Friday 2/22 - 177 - 2958, worked out
Saturday 2/23 - 176.4 - 3060, no exercise, ribs for dinner, cake & ice cream w/ family from out of state
Sunday 2/24 - 179.6 - 3603, no exercise, higher-than-normal stress, way too much cake
Monday 2/25 - 180.8 - tripped the outlier metric in my OP
Tuesday 2/26 - 177, rolling average up to 177.3
*Compare to incoming rolling 7-day average weight of 177.1 lbs, average observed TDEE of 25455 -
I referenced this post in another thread and decided to look at my full data set again. To date I'm up to 936 data points. Interestingly, the 2/25/19 weight is not considered an outlier in terms of the full data set, though I did have a second outlier on 1/12/2020.
Some observations about daily weight with a trend vs. point-to-point comparisons:
- my daily data points range from 170-186.8 aka a 16.8 lb spread
- my 10 day trailing average data points range from 171.5-181.66 aka 10.16 lb spread
- the averages and medians don't really differ between the two sets though
Graph for context:
5 -
So 10 day trailing average (aka, I believe, trendweight) works as advertised? 🤔 AND you win the weigh in data points contest! 😎0
-
Linked this in another thread again so I thought it was time for an update. I'm up over four full years of data now and still only two true outliers.
In the context of observing trend weight with respect to water fluctuations (as per the question in the other thread), the smoothing effect is predictably far more pronounced on the peaks rather than the valleys, and the average is virtually identical (0.01% difference). The max trend weight is 2.83% lower than max daily weight while my min trend is 0.87% higher than the daily min number.2
Categories
- All Categories
- 1.4M Health, Wellness and Goals
- 393.6K Introduce Yourself
- 43.8K Getting Started
- 260.3K Health and Weight Loss
- 175.9K Food and Nutrition
- 47.5K Recipes
- 232.5K Fitness and Exercise
- 431 Sleep, Mindfulness and Overall Wellness
- 6.5K Goal: Maintaining Weight
- 8.6K Goal: Gaining Weight and Body Building
- 153K Motivation and Support
- 8K Challenges
- 1.3K Debate Club
- 96.3K Chit-Chat
- 2.5K Fun and Games
- 3.8K MyFitnessPal Information
- 24 News and Announcements
- 1.1K Feature Suggestions and Ideas
- 2.6K MyFitnessPal Tech Support Questions